Sep 03 19:55:22 devstack cinder-volume[76613]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 19:55:22 devstack cinder-volume[76613]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 19:55:22 devstack cinder-volume[76613]: we strongly recommend against using it for new projects. Sep 03 19:55:22 devstack cinder-volume[76613]: If you are already using Eventlet, we recommend migrating to a different Sep 03 19:55:22 devstack cinder-volume[76613]: framework. For more detail see Sep 03 19:55:22 devstack cinder-volume[76613]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 19:55:22 devstack cinder-volume[76613]: import eventlet # noqa Sep 03 19:55:24 devstack cinder-volume[76613]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76613) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 19:55:24 devstack cinder-volume[76613]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76613) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 19:55:24 devstack cinder-volume[76613]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76613) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 19:55:25 devstack cinder-volume[76613]: INFO dbcounter [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Registered counter for database cinder Sep 03 19:55:25 devstack cinder-volume[76613]: DEBUG oslo_db.sqlalchemy.engines [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76613) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 19:55:26 devstack cinder-volume[76613]: DEBUG dbcounter [-] [76613] Writer thread running {{(pid=76613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 19:55:26 devstack cinder-volume[76613]: INFO cinder.rpc [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 19:55:26 devstack cinder-volume[76613]: INFO cinder.rpc [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 19:55:26 devstack cinder-volume[76613]: DEBUG oslo_db.sqlalchemy.engines [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76613) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 19:55:26 devstack cinder-volume[76613]: INFO cinder.volume.manager [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Determined volume DB was empty at startup. Sep 03 19:55:26 devstack cinder-volume[76613]: DEBUG cinder.volume.manager [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76613) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 19:55:26 devstack cinder-volume[76613]: INFO cinder.volume.manager [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 03 19:55:26 devstack cinder-volume[76613]: WARNING stevedore.named [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 19:55:26 devstack cinder-volume[76613]: WARNING castellan.key_manager [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 19:55:26 devstack cinder-volume[76613]: WARNING cinder.keymgr.conf_key_mgr [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 19:55:26 devstack cinder-volume[76613]: DEBUG cinder.volume.drivers.lvm [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76613) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 03 19:55:26 devstack cinder-volume[76613]: DEBUG oslo_concurrency.processutils [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:26 devstack cinder-volume[76613]: DEBUG oslo_concurrency.processutils [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] CMD "cinder-rtstool verify" returned: 0 in 0.528s {{(pid=76613) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_db.sqlalchemy.engines [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76613) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 19:55:27 devstack cinder-volume[76613]: INFO cinder.rpc [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 03 19:55:27 devstack cinder-volume[76613]: INFO cinder.rpc [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 03 19:55:27 devstack cinder-volume[76613]: WARNING stevedore.named [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 19:55:27 devstack cinder-volume[76613]: WARNING castellan.key_manager [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 19:55:27 devstack cinder-volume[76613]: INFO cinder.volume.manager [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_db.sqlalchemy.engines [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76613) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 19:55:27 devstack cinder-volume[76613]: INFO oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Starting 1 workers Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Started child 76800 {{(pid=76613) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Full set of CONF: {{(pid=76613) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] ******************************************************************************** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Configuration options gathered from: {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] ================================================================================ {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] allow_availability_zone_fallback = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] allow_compression_on_image_upload = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] allowed_direct_url_schemes = [] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] api_rate_limit = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] auth_strategy = keystone {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] az_cache_duration = 3600 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_availability_zone = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_host = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_name = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_stats_polling_interval = 60 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backup_api_class = cinder.backup.api.API {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backup_name_template = backup-%s {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backup_use_same_host = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backup_use_temp_snapshot = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] chap_password = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76800]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] chap_username = {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cinder_internal_tenant_project_id = a2dfd78e79b74922b850fe72c517cf0e {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cinder_internal_tenant_user_id = a0284a3c215447909a4881d871437ecf {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cloned_volume_same_az = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cluster = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] compression_format = gzip {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] compute_api_class = cinder.compute.nova.API {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] config_dir = [] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] config_source = [] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] control_exchange = openstack {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] debug = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] default_availability_zone = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] default_group_type = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] default_volume_type = lvmdriver-1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] disk_geometry = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] driver_client_cert = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] driver_client_cert_key = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] driver_data_namespace = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] driver_ssl_cert_path = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] driver_ssl_cert_verify = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] driver_use_ssl = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] enable_force_upload = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] enable_new_services = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] enable_unsupported_driver = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] enforce_multipath_for_image_xfer = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] filter_function = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance_api_insecure = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance_api_servers = ['http://192.168.122.54/image'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance_api_ssl_compression = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance_ca_certificates_file = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance_catalog_info = image:glance:publicURL {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance_certfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance_keyfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance_num_retries = 3 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance_request_timeout = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] goodness_function = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] graceful_shutdown_timeout = 5 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] group_api_class = cinder.group.api.API {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] host = devstack {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] image_compress_on_upload = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] image_conversion_address_space_limit = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] image_conversion_cpu_limit = 60 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] image_conversion_disable = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] image_upload_use_cinder_backend = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] image_upload_use_internal_tenant = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] image_volume_cache_enabled = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] image_volume_cache_max_count = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] image_volume_cache_max_size_gb = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] init_host_max_objects_retrieval = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] instance_format = [instance: %(uuid)s] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] iscsi_target_flags = {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] iscsi_write_cache = on {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] iser_helper = tgtadm {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] iser_ip_address = 192.168.122.54 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] iser_port = 3260 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] log_color = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] log_config_append = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] log_dir = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] log_file = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] log_options = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] log_rotate_interval = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] log_rotate_interval_type = days {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] log_rotation_type = none {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] max_age = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] max_logfile_count = 30 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] max_logfile_size_mb = 200 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] max_over_subscription_ratio = 20.0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] message_reap_interval = 86400 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] message_ttl = 2592000 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] migration_create_volume_timeout_secs = 300 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] monkey_patch = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] monkey_patch_modules = [] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] my_ip = 192.168.122.54 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] no_snapshot_gb_quota = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] num_iser_scan_tries = 3 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] num_shell_tries = 3 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] num_volume_device_scan_tries = 3 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] nvmeof_conn_info_version = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] nvmet_ns_id = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] nvmet_port_id = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] osapi_max_limit = 1000 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] osapi_volume_ext_list = [] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] osapi_volume_listen_port = 8776 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] osapi_volume_use_ssl = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] osapi_volume_workers = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] per_volume_size_limit = -1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] periodic_fuzzy_delay = 60 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] periodic_interval = 60 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] public_endpoint = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] publish_errors = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] quota_backup_gigabytes = 1000 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] quota_backups = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] quota_gigabytes = 1000 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] quota_groups = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] quota_snapshots = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] quota_volumes = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] rate_limit_burst = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] rate_limit_except_level = CRITICAL {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] rate_limit_interval = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] reinit_driver_count = 3 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] replication_device = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] report_discard_supported = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] report_interval = 120 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] reservation_clean_interval = 86400 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] reservation_expire = 86400 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] reserved_image_namespaces = [] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] reserved_percentage = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] rpc_response_timeout = 120 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] run_external_periodic_tasks = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] scst_target_driver = iscsi {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] scst_target_iqn_name = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] service_down_time = 720 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] shell_completion = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] snapshot_name_template = snapshot-%s {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] snapshot_same_host = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] split_loggers = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] state_path = /opt/stack/data/cinder {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] storage_availability_zone = nova {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] storage_protocol = iSCSI {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] syslog_log_facility = LOG_USER {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] target_helper = lioadm {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] target_ip_address = 192.168.122.54 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] target_port = 3260 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] target_protocol = iscsi {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] target_secondary_ip_addresses = [] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] trace_flags = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] transport_url = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] until_refresh = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] use_chap_auth = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76800]: INFO cinder.volume.manager [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] use_default_quota_class = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] use_journal = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] use_json = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] use_multipath_for_image_xfer = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] use_stderr = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] use_syslog = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] verify_glance_signatures = enabled {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] volume_api_class = cinder.volume.api.API {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] volume_backend_name = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] volume_clear = zero {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] volume_clear_ionice = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] volume_clear_size = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] volume_copy_bps_limit = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] volume_dd_blocksize = 1M {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] volume_name_template = volume-%s {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] volume_service_inithost_offload = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] volume_usage_audit_period = month {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] zoning_mode = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_concurrency.disable_process_locking = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.auth_section = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.auth_type = password {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.auth_version = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.cache = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.certfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.include_service_catalog = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.insecure = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.interface = public {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.keyfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_password = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcache_username = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.region_name = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.service_type = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.059s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.54/identity {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.backend = dogpile.cache.null {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.backend_argument = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.backend_expiration_time = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.config_prefix = cache.oslo {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.debug_cache_backend = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.enable_retry_client = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.enable_socket_keepalive = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.enabled = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.expiration_time = 600 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.hashclient_retry_attempts = 2 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.memcache_dead_retry = 300 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.memcache_pool_maxsize = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.memcache_sasl_enabled = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.password = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.proxies = [] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.redis_db = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.redis_server = localhost:6379 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.retry_attempts = 2 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.retry_delay = 0.0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.socket_keepalive_count = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.socket_keepalive_idle = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.socket_keepalive_interval = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.socket_timeout = 1.0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.tls_allowed_ciphers = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.tls_cafile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.tls_certfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.tls_enabled = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.tls_keyfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cache.username = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] coordination.backend_url = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.asyncio_connection = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.asyncio_slave_connection = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.backend = sqlalchemy {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.connection = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.connection_debug = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.connection_parameters = {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.connection_recycle_time = 3600 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.connection_trace = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.db_inc_retry_interval = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.db_max_retries = 20 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.db_max_retry_interval = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.db_retry_interval = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.max_overflow = 50 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.max_pool_size = 5 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.max_retries = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.mysql_wsrep_sync_wait = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.pool_timeout = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.retry_interval = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.slave_connection = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.sqlite_synchronous = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.synchronous_reader = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] database.use_db_reconnect = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_tracing.insecure = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler.connection_string = messaging:// {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler.enabled = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler.es_doc_type = notification {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler.es_scroll_size = 10000 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler.es_scroll_time = 2m {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler.filter_error_trace = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler.hmac_keys = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler.sentinel_service_name = mymaster {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler.socket_timeout = 0.1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler.trace_requests = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler.trace_sqlalchemy = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler_jaeger.process_tags = {} {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler_jaeger.service_name_prefix = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] profiler_otlp.service_name_prefix = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_policy.enforce_new_defaults = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:27 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_policy.policy_default_rule = default {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_policy.policy_file = policy.yaml {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] privsep_osbrick.group = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] privsep_osbrick.helper_command = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] privsep_osbrick.user = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cinder_sys_admin.group = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cinder_sys_admin.helper_command = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] cinder_sys_admin.user = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] service_user.auth_section = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] service_user.auth_type = password {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] service_user.cafile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] service_user.certfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] service_user.collect_timing = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] service_user.insecure = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] service_user.keyfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] service_user.send_service_user_token = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] service_user.split_loggers = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] service_user.timeout = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] service_user.tls_ciphers = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] service_user.tls_min_version = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance.auth_section = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance.auth_type = password {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance.certfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance.collect_timing = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance.insecure = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance.keyfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance.region_name = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance.split_loggers = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance.timeout = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance.tls_ciphers = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] glance.tls_min_version = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.backend_availability_zone = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack sudo[76807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.chap_password = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.chap_username = {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack sudo[76807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.disk_geometry = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.driver_client_cert = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.driver_client_cert_key = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.driver_data_namespace = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.driver_use_ssl = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.extra_capabilities = {} {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.filter_function = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.goodness_function = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.iscsi_target_flags = {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.iscsi_write_cache = on {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.iser_helper = tgtadm {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.iser_ip_address = 192.168.122.54 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.iser_port = 3260 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.lvm_share_target = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.lvm_type = auto {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.num_shell_tries = 3 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.replication_device = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.report_discard_supported = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.reserved_percentage = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.target_helper = tgtadm {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.target_ip_address = 192.168.122.54 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.target_port = 3260 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.target_protocol = iscsi {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.trace_flags = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.unique_fqdn_network = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.use_chap_auth = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.volume_backend_name = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.volume_clear = zero {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.volume_clear_ionice = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.volume_clear_size = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_reports.file_event_handler = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_reports.log_dir = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.backend_host = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.chap_password = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.chap_username = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.disk_geometry = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.driver_client_cert = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.extra_capabilities = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.filter_function = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.goodness_function = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.iser_helper = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.iser_ip_address = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.iser_port = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.lvm_share_target = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.lvm_type = auto {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.num_shell_tries = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.replication_device = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.report_discard_supported = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.reserved_percentage = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.scst_target_driver = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.storage_protocol = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.target_helper = lioadm {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.target_ip_address = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.target_port = 3260 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.trace_flags = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.use_chap_auth = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.volume_clear = zero {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.volume_clear_size = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] lvmdriver-1.volumes_dir = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.ssl = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_notifications.driver = [] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_notifications.retry = -1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] key_manager.fixed_key = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.barbican_api_version = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.barbican_endpoint = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.barbican_endpoint_type = public {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.barbican_region_name = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.cafile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.certfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.collect_timing = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.insecure = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.keyfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.number_of_retries = 60 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.retry_delay = 1 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.send_service_user_token = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.split_loggers = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.timeout = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.tls_ciphers = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.tls_min_version = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.verify_ssl = True {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican.verify_ssl_path = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican_service_user.auth_section = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican_service_user.auth_type = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican_service_user.cafile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican_service_user.certfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican_service_user.collect_timing = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican_service_user.insecure = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican_service_user.keyfile = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican_service_user.split_loggers = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican_service_user.timeout = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican_service_user.tls_ciphers = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] barbican_service_user.tls_min_version = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.approle_role_id = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.approle_secret_id = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.auth_method = approle {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.auth_path = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.kv_mountpoint = secret {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.kv_path = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.kv_version = 2 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.namespace = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.root_token_id = **** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.ssl_ca_crt_file = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.timeout = 60.0 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.token_file = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.token_role = None {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.use_ssl = False {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 19:55:27 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] ******************************************************************************** {{(pid=76613) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 19:55:27 devstack sudo[76807]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:27 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:27 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:27 devstack sudo[76960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 19:55:27 devstack sudo[76960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:28 devstack sudo[76960]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:28 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.300s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:28 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 19:55:28 devstack cinder-volume[76800]: INFO cinder.brick.local_dev.lvm [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 03 19:55:28 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:28 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:28 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:28 devstack sudo[77053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 19:55:28 devstack sudo[77053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:28 devstack sudo[77053]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:28 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:28 devstack cinder-volume[76800]: DEBUG cinder.brick.local_dev.lvm [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76800) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 03 19:55:28 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:28 devstack sudo[77146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 19:55:28 devstack sudo[77146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:28 devstack sudo[77146]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:28 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.506s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:28 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:28 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:28 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:29 devstack sudo[77338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 19:55:29 devstack sudo[77338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:29 devstack sudo[77338]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:29 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.303s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:29 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:29 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:29 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:29 devstack sudo[77418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 03 19:55:29 devstack sudo[77418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:29 devstack sudo[77418]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:29 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.248s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:29 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:29 devstack sudo[77430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 19:55:29 devstack sudo[77430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:29 devstack sudo[77430]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:29 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.349s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:29 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:29 devstack sudo[77505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 19:55:29 devstack sudo[77505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:30 devstack sudo[77505]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:30 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:30 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:30 devstack sudo[77514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:55:30 devstack sudo[77514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:30 devstack sudo[77514]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:30 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.351s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:30 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:30 devstack sudo[77598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 19:55:30 devstack sudo[77598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:30 devstack sudo[77598]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:30 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:30 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:30 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:30 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:30 devstack sudo[77602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 19:55:30 devstack sudo[77602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:31 devstack sudo[77602]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:31 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:31 devstack cinder-volume[76800]: INFO cinder.volume.drivers.lvm [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 03 19:55:31 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:31 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:31 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:31 devstack sudo[77606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 19:55:31 devstack sudo[77606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:31 devstack sudo[77606]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:31 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:31 devstack cinder-volume[76800]: DEBUG cinder.volume.drivers.lvm [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Updating volume stats {{(pid=76800) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 19:55:31 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:31 devstack sudo[77609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 19:55:31 devstack sudo[77609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:31 devstack sudo[77609]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:31 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:31 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:31 devstack sudo[77612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:55:31 devstack sudo[77612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:32 devstack sudo[77612]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:32 devstack sudo[77621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 19:55:32 devstack sudo[77621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:32 devstack sudo[77621]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:32 devstack sudo[77624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:55:32 devstack sudo[77624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:32 devstack sudo[77624]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:32 devstack cinder-volume[76800]: INFO cinder.volume.driver [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Driver hasn't implemented _init_vendor_properties() Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG cinder.volume.driver [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76800) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG oslo_db.sqlalchemy.engines [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76800) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG dbcounter [-] [76800] Writer thread running {{(pid=76800) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG cinder.db.api [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Building query based on filter {{(pid=76800) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG cinder.image.image_utils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76800) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 19:55:32 devstack cinder-volume[76800]: INFO cinder.keymgr.migration [None req-c9064a57-def1-4402-86d7-57da4337024a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG cinder.volume.drivers.lvm [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Updating volume stats {{(pid=76800) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:32 devstack sudo[77629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 19:55:32 devstack sudo[77629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:32 devstack sudo[77629]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:32 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:32 devstack sudo[77632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:55:32 devstack sudo[77632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:33 devstack sudo[77632]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:33 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:33 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:33 devstack sudo[77636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 19:55:33 devstack sudo[77636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:33 devstack sudo[77636]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:33 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:33 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:33 devstack sudo[77639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:55:33 devstack sudo[77639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:33 devstack sudo[77639]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:33 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:33 devstack cinder-volume[76800]: DEBUG cinder.manager [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Notifying Schedulers of capabilities ... {{(pid=76800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 19:55:33 devstack cinder-volume[76800]: INFO cinder.volume.manager [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Driver initialization completed successfully. Sep 03 19:55:33 devstack cinder-volume[76800]: INFO cinder.manager [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Initiating service 2 cleanup Sep 03 19:55:33 devstack cinder-volume[76800]: INFO cinder.manager [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Service 2 cleanup completed. Sep 03 19:55:33 devstack cinder-volume[76800]: DEBUG cinder.service [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Creating RPC server for service cinder-volume {{(pid=76800) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 19:55:33 devstack cinder-volume[76800]: DEBUG cinder.service [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76800) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 19:55:33 devstack cinder-volume[76800]: INFO cinder.volume.manager [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 03 19:55:33 devstack cinder-volume[76800]: DEBUG cinder.volume.drivers.lvm [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Updating volume stats {{(pid=76800) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 19:55:33 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:33 devstack sudo[77644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 19:55:33 devstack sudo[77644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:34 devstack sudo[77644]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:34 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:34 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:34 devstack sudo[77647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:55:34 devstack sudo[77647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:34 devstack sudo[77647]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:34 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:34 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:34 devstack sudo[77650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 19:55:34 devstack sudo[77650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:34 devstack sudo[77650]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:34 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:34 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:55:34 devstack sudo[77653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:55:34 devstack sudo[77653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:55:34 devstack sudo[77653]: pam_unix(sudo:session): session closed for user root Sep 03 19:55:34 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:55:34 devstack cinder-volume[76800]: INFO cinder.volume.manager [None req-ab7bf576-a231-499d-a10e-5102d94b7a2c None None] Driver post RPC initialization completed successfully. Sep 03 19:55:37 devstack cinder-volume[76613]: DEBUG dbcounter [-] [76613] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76613) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 19:55:43 devstack cinder-volume[76800]: DEBUG dbcounter [-] [76800] Writing DB stats cinder:SELECT=3 {{(pid=76800) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 19:55:44 devstack cinder-volume[76800]: DEBUG dbcounter [-] [76800] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76800) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 19:55:57 devstack cinder-volume[76800]: DEBUG oslo_service.periodic_task [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running periodic task VolumeManager._thread_info {{(pid=76800) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 19:55:57 devstack cinder-volume[76800]: DEBUG cinder.volume.manager [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] thread count: 6 {{(pid=76800) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 19:55:57 devstack cinder-volume[76800]: DEBUG cinder.volume.manager [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] thread info: [<_MainThread(MainThread, started 137906278609024)>, , , , , ] {{(pid=76800) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 19:56:57 devstack cinder-volume[76800]: DEBUG oslo_service.periodic_task [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76800) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 19:56:57 devstack cinder-volume[76800]: DEBUG cinder.volume.drivers.lvm [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Updating volume stats {{(pid=76800) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 19:56:57 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:56:58 devstack sudo[80292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 19:56:58 devstack sudo[80292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:56:58 devstack sudo[80292]: pam_unix(sudo:session): session closed for user root Sep 03 19:56:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:56:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:56:58 devstack sudo[80295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:56:58 devstack sudo[80295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:56:58 devstack sudo[80295]: pam_unix(sudo:session): session closed for user root Sep 03 19:56:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:56:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:56:58 devstack sudo[80298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 19:56:58 devstack sudo[80298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:56:58 devstack sudo[80298]: pam_unix(sudo:session): session closed for user root Sep 03 19:56:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:56:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:56:58 devstack sudo[80301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:56:58 devstack sudo[80301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:56:58 devstack sudo[80301]: pam_unix(sudo:session): session closed for user root Sep 03 19:56:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:56:58 devstack cinder-volume[76800]: DEBUG cinder.manager [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Notifying Schedulers of capabilities ... {{(pid=76800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 19:56:58 devstack cinder-volume[76800]: DEBUG oslo_service.periodic_task [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running periodic task VolumeManager._thread_info {{(pid=76800) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 19:56:58 devstack cinder-volume[76800]: DEBUG cinder.volume.manager [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] thread count: 6 {{(pid=76800) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 19:56:59 devstack cinder-volume[76800]: DEBUG cinder.volume.manager [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] thread info: [<_MainThread(MainThread, started 137906278609024)>, , , , , ] {{(pid=76800) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 19:57:45 devstack cinder-volume[76800]: DEBUG dbcounter [-] [76800] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76800) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 19:57:57 devstack cinder-volume[76800]: DEBUG oslo_service.periodic_task [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76800) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 19:57:57 devstack cinder-volume[76800]: DEBUG cinder.volume.drivers.lvm [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Updating volume stats {{(pid=76800) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 19:57:57 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:57:58 devstack sudo[83557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 19:57:58 devstack sudo[83557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:57:58 devstack sudo[83557]: pam_unix(sudo:session): session closed for user root Sep 03 19:57:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:57:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:57:58 devstack sudo[83560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:57:58 devstack sudo[83560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:57:58 devstack sudo[83560]: pam_unix(sudo:session): session closed for user root Sep 03 19:57:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:57:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:57:58 devstack sudo[83566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 19:57:58 devstack sudo[83566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:57:58 devstack sudo[83566]: pam_unix(sudo:session): session closed for user root Sep 03 19:57:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:57:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:57:58 devstack sudo[83749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:57:58 devstack sudo[83749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:57:59 devstack sudo[83749]: pam_unix(sudo:session): session closed for user root Sep 03 19:57:59 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:57:59 devstack cinder-volume[76800]: DEBUG cinder.manager [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Notifying Schedulers of capabilities ... {{(pid=76800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 19:58:57 devstack cinder-volume[76800]: DEBUG oslo_service.periodic_task [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76800) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 19:58:57 devstack cinder-volume[76800]: DEBUG cinder.volume.drivers.lvm [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Updating volume stats {{(pid=76800) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 19:58:57 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:58:58 devstack sudo[85618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 19:58:58 devstack sudo[85618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:58:58 devstack sudo[85618]: pam_unix(sudo:session): session closed for user root Sep 03 19:58:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:58:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:58:58 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:58:58 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:58:58 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Sep 03 19:58:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:58:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:58:58 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 19:58:58 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:58:58 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Sep 03 19:58:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:58:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:58:58 devstack sudo[85639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:58:58 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:58:59 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root Sep 03 19:58:59 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:58:59 devstack cinder-volume[76800]: DEBUG cinder.manager [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Notifying Schedulers of capabilities ... {{(pid=76800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 19:58:59 devstack cinder-volume[76800]: DEBUG oslo_service.periodic_task [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running periodic task VolumeManager._thread_info {{(pid=76800) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 19:58:59 devstack cinder-volume[76800]: DEBUG cinder.volume.manager [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] thread count: 6 {{(pid=76800) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 19:58:59 devstack cinder-volume[76800]: DEBUG cinder.volume.manager [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] thread info: [<_MainThread(MainThread, started 137906278609024)>, , , , , ] {{(pid=76800) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 19:59:45 devstack cinder-volume[76800]: DEBUG dbcounter [-] [76800] Writing DB stats cinder:SELECT=1 {{(pid=76800) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 19:59:45 devstack cinder-volume[76800]: DEBUG dbcounter [-] [76800] Writing DB stats cinder:UPDATE=1 {{(pid=76800) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 19:59:55 devstack cinder-volume[76613]: INFO oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Caught SIGTERM, stopping children Sep 03 19:59:55 devstack cinder-volume[76613]: DEBUG oslo_concurrency.lockutils [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Acquiring lock "singleton_lock" {{(pid=76613) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 19:59:55 devstack cinder-volume[76613]: DEBUG oslo_concurrency.lockutils [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Acquired lock "singleton_lock" {{(pid=76613) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 19:59:55 devstack cinder-volume[76613]: DEBUG oslo_concurrency.lockutils [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Releasing lock "singleton_lock" {{(pid=76613) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 19:59:55 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Stop services. {{(pid=76613) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 03 19:59:55 devstack cinder-volume[76613]: DEBUG oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Killing children. {{(pid=76613) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 03 19:59:55 devstack cinder-volume[76613]: INFO oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Waiting on 1 children to exit Sep 03 19:59:57 devstack cinder-volume[76800]: DEBUG oslo_service.periodic_task [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76800) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 19:59:57 devstack cinder-volume[76800]: DEBUG cinder.volume.drivers.lvm [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Updating volume stats {{(pid=76800) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 19:59:57 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:59:58 devstack sudo[86779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 19:59:58 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:59:58 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root Sep 03 19:59:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:59:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:59:58 devstack sudo[86782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:59:58 devstack sudo[86782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:59:58 devstack sudo[86782]: pam_unix(sudo:session): session closed for user root Sep 03 19:59:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:59:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:59:58 devstack sudo[86785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 19:59:58 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:59:58 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root Sep 03 19:59:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:59:58 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 19:59:58 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 19:59:58 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 19:59:59 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Sep 03 19:59:59 devstack cinder-volume[76800]: DEBUG oslo_concurrency.processutils [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 19:59:59 devstack cinder-volume[76800]: DEBUG cinder.manager [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Notifying Schedulers of capabilities ... {{(pid=76800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 19:59:59 devstack cinder-volume[76800]: DEBUG oslo_service.periodic_task [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] Running periodic task VolumeManager._thread_info {{(pid=76800) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 19:59:59 devstack cinder-volume[76800]: DEBUG cinder.volume.manager [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] thread count: 5 {{(pid=76800) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 19:59:59 devstack cinder-volume[76800]: DEBUG cinder.volume.manager [None req-8b28a6aa-dc0f-4bdf-be37-3aaac0eb1adf None None] thread info: [<_MainThread(MainThread, started 137906278609024)>, , , , ] {{(pid=76800) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 19:59:59 devstack cinder-volume[76800]: DEBUG oslo_concurrency.lockutils [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Acquiring lock "singleton_lock" {{(pid=76800) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 19:59:59 devstack cinder-volume[76800]: DEBUG oslo_concurrency.lockutils [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Acquired lock "singleton_lock" {{(pid=76800) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 19:59:59 devstack cinder-volume[76800]: DEBUG oslo_concurrency.lockutils [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Releasing lock "singleton_lock" {{(pid=76800) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 19:59:59 devstack cinder-volume[76800]: WARNING amqp [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 19:59:59 devstack cinder-volume[76800]: WARNING amqp [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 19:59:59 devstack cinder-volume[76613]: INFO oslo_service.backend._eventlet.service [None req-8ffaccbe-faf4-4827-a3be-5e1215008374 None None] Child 76800 exited with status 0 Sep 03 19:59:59 devstack cinder-volume[86792]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 19:59:59 devstack cinder-volume[86792]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 19:59:59 devstack cinder-volume[86792]: we strongly recommend against using it for new projects. Sep 03 19:59:59 devstack cinder-volume[86792]: If you are already using Eventlet, we recommend migrating to a different Sep 03 19:59:59 devstack cinder-volume[86792]: framework. For more detail see Sep 03 19:59:59 devstack cinder-volume[86792]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 19:59:59 devstack cinder-volume[86792]: import eventlet # noqa Sep 03 20:00:01 devstack cinder-volume[86792]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 20:00:01 devstack cinder-volume[86792]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 20:00:01 devstack cinder-volume[86792]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 20:00:02 devstack cinder-volume[86792]: INFO dbcounter [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Registered counter for database cinder Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_db.sqlalchemy.engines [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86792) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG dbcounter [-] [86792] Writer thread running {{(pid=86792) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 20:00:02 devstack cinder-volume[86792]: INFO cinder.rpc [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 20:00:02 devstack cinder-volume[86792]: INFO cinder.rpc [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_db.sqlalchemy.engines [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86792) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 20:00:02 devstack cinder-volume[86792]: INFO cinder.volume.manager [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Determined volume DB was empty at startup. Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG cinder.volume.manager [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86792) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 20:00:02 devstack cinder-volume[86792]: INFO cinder.volume.manager [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 03 20:00:02 devstack cinder-volume[86792]: WARNING stevedore.named [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 20:00:02 devstack cinder-volume[86792]: WARNING castellan.key_manager [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 20:00:02 devstack cinder-volume[86792]: WARNING cinder.keymgr.conf_key_mgr [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 20:00:02 devstack cinder-volume[86792]: INFO cinder.volume.manager [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_db.sqlalchemy.engines [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86792) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 20:00:02 devstack cinder-volume[86792]: INFO oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Starting 1 workers Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Started child 87009 {{(pid=86792) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Full set of CONF: {{(pid=86792) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] ******************************************************************************** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Configuration options gathered from: {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] ================================================================================ {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] allow_availability_zone_fallback = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] allow_compression_on_image_upload = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] allowed_direct_url_schemes = [] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] api_rate_limit = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] auth_strategy = keystone {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_availability_zone = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_host = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_name = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_stats_polling_interval = 60 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backup_api_class = cinder.backup.api.API {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backup_name_template = backup-%s {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backup_use_same_host = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[87009]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backup_use_temp_snapshot = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] chap_password = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] chap_username = {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cinder_internal_tenant_project_id = a2dfd78e79b74922b850fe72c517cf0e {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cinder_internal_tenant_user_id = a0284a3c215447909a4881d871437ecf {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cluster = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] compression_format = gzip {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] compute_api_class = cinder.compute.nova.API {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] config_dir = [] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] config_source = [] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] control_exchange = openstack {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] debug = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] default_availability_zone = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] default_group_type = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] default_volume_type = QuobyteHD {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] disk_geometry = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] driver_client_cert = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] driver_client_cert_key = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] driver_data_namespace = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] driver_ssl_cert_path = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] driver_ssl_cert_verify = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] driver_use_ssl = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] enable_new_services = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] enable_unsupported_driver = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] enabled_backends = ['QuobyteHD'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] enforce_multipath_for_image_xfer = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] filter_function = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance_api_insecure = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance_api_servers = ['http://192.168.122.54/image'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance_api_ssl_compression = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance_ca_certificates_file = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance_catalog_info = image:glance:publicURL {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance_certfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance_keyfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance_num_retries = 3 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance_request_timeout = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] goodness_function = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] graceful_shutdown_timeout = 5 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] group_api_class = cinder.group.api.API {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] host = devstack {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] image_compress_on_upload = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] image_conversion_address_space_limit = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] image_conversion_cpu_limit = 60 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] image_conversion_disable = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] image_upload_use_cinder_backend = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] image_upload_use_internal_tenant = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] image_volume_cache_enabled = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] image_volume_cache_max_count = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] image_volume_cache_max_size_gb = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] init_host_max_objects_retrieval = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] instance_format = [instance: %(uuid)s] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] iscsi_target_flags = {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] iscsi_write_cache = on {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] iser_helper = tgtadm {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] iser_ip_address = 192.168.122.54 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] iser_port = 3260 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] log_color = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] log_config_append = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] log_dir = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] log_file = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] log_options = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] log_rotate_interval = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] log_rotate_interval_type = days {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] log_rotation_type = none {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] max_age = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] max_logfile_count = 30 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] max_logfile_size_mb = 200 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] max_over_subscription_ratio = 20.0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] message_reap_interval = 86400 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] message_ttl = 2592000 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] migration_create_volume_timeout_secs = 300 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] monkey_patch = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] monkey_patch_modules = [] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] my_ip = 192.168.122.54 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] no_snapshot_gb_quota = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] num_iser_scan_tries = 3 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] num_shell_tries = 3 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] num_volume_device_scan_tries = 3 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] nvmeof_conn_info_version = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] nvmet_ns_id = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] nvmet_port_id = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] osapi_max_limit = 1000 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 03 20:00:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87009) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] osapi_volume_ext_list = [] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] osapi_volume_listen_port = 8776 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] osapi_volume_use_ssl = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] osapi_volume_workers = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] per_volume_size_limit = -1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] periodic_fuzzy_delay = 60 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] periodic_interval = 60 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] public_endpoint = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] publish_errors = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] quota_backup_gigabytes = 1000 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] quota_backups = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] quota_gigabytes = 1000 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] quota_groups = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] quota_snapshots = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] quota_volumes = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] rate_limit_burst = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] rate_limit_except_level = CRITICAL {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] rate_limit_interval = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] reinit_driver_count = 3 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] replication_device = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] report_discard_supported = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] report_interval = 120 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] reservation_clean_interval = 86400 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] reservation_expire = 86400 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] reserved_image_namespaces = [] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] reserved_percentage = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] rpc_response_timeout = 120 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] run_external_periodic_tasks = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] scst_target_driver = iscsi {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:02 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] scst_target_iqn_name = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] service_down_time = 720 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] shell_completion = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] snapshot_name_template = snapshot-%s {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] split_loggers = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] state_path = /opt/stack/data/cinder {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] storage_availability_zone = nova {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] storage_protocol = iSCSI {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] syslog_log_facility = LOG_USER {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] target_helper = lioadm {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] target_ip_address = 192.168.122.54 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] target_port = 3260 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] target_protocol = iscsi {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] target_secondary_ip_addresses = [] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] trace_flags = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] transport_url = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] until_refresh = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] use_chap_auth = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] use_default_quota_class = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] use_journal = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] use_json = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] use_multipath_for_image_xfer = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] use_stderr = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] use_syslog = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] verify_glance_signatures = enabled {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] volume_api_class = cinder.volume.api.API {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] volume_backend_name = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] volume_clear = zero {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] volume_clear_ionice = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] volume_clear_size = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] volume_copy_bps_limit = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] volume_dd_blocksize = 1M {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] volume_name_template = volume-%s {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] volume_service_inithost_offload = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] volume_usage_audit_period = month {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] zoning_mode = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_concurrency.disable_process_locking = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.auth_section = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.auth_type = password {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.auth_version = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.cache = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.certfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.include_service_catalog = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.insecure = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.interface = public {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.keyfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_password = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87009) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.quobyte [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.quobyte [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcache_username = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.region_name = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Running cmd (subprocess): mount.quobyte {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.service_type = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.54/identity {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.backend = dogpile.cache.null {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.backend_argument = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.backend_expiration_time = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.config_prefix = cache.oslo {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.debug_cache_backend = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.enable_retry_client = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.enable_socket_keepalive = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.enabled = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.expiration_time = 600 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.hashclient_retry_attempts = 2 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.memcache_dead_retry = 300 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.memcache_pool_maxsize = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.memcache_sasl_enabled = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.password = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.proxies = [] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.redis_db = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.redis_server = localhost:6379 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.retry_attempts = 2 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.retry_delay = 0.0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.socket_keepalive_count = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.socket_keepalive_idle = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.socket_keepalive_interval = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.socket_timeout = 1.0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.tls_allowed_ciphers = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.tls_cafile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.tls_certfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.tls_enabled = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.tls_keyfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cache.username = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] coordination.backend_url = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.asyncio_connection = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.asyncio_slave_connection = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.backend = sqlalchemy {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.connection = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.connection_debug = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.connection_parameters = {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.connection_recycle_time = 3600 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.connection_trace = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.db_inc_retry_interval = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.db_max_retries = 20 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.db_max_retry_interval = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.db_retry_interval = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.max_overflow = 50 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.max_pool_size = 5 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.max_retries = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.mysql_wsrep_sync_wait = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.pool_timeout = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.retry_interval = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.slave_connection = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.sqlite_synchronous = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.synchronous_reader = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] database.use_db_reconnect = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_tracing.insecure = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler.connection_string = messaging:// {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler.enabled = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler.es_doc_type = notification {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler.es_scroll_size = 10000 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler.es_scroll_time = 2m {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler.filter_error_trace = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler.hmac_keys = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler.sentinel_service_name = mymaster {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler.socket_timeout = 0.1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler.trace_requests = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler.trace_sqlalchemy = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler_jaeger.process_tags = {} {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler_jaeger.service_name_prefix = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] profiler_otlp.service_name_prefix = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_policy.enforce_new_defaults = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_policy.policy_default_rule = default {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_policy.policy_file = policy.yaml {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] privsep_osbrick.group = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] privsep_osbrick.helper_command = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] privsep_osbrick.user = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cinder_sys_admin.group = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cinder_sys_admin.helper_command = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] cinder_sys_admin.user = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] service_user.auth_section = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] service_user.auth_type = password {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] service_user.cafile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] service_user.certfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] service_user.collect_timing = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] service_user.insecure = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] service_user.keyfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] service_user.send_service_user_token = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] service_user.split_loggers = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] service_user.timeout = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] service_user.tls_ciphers = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] service_user.tls_min_version = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance.auth_section = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance.auth_type = password {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance.certfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance.collect_timing = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance.insecure = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance.keyfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance.region_name = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance.split_loggers = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance.timeout = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance.tls_ciphers = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] glance.tls_min_version = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.backend_availability_zone = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.chap_password = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.chap_username = {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.disk_geometry = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.driver_client_cert = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.driver_client_cert_key = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.driver_data_namespace = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.driver_use_ssl = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.extra_capabilities = {} {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.filter_function = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.goodness_function = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.iscsi_target_flags = {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.iscsi_write_cache = on {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.iser_helper = tgtadm {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.iser_ip_address = 192.168.122.54 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.iser_port = 3260 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.nas_host = {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.nas_login = admin {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.nas_mount_options = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.nas_password = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.nas_private_key = {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.nas_share_path = {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.num_shell_tries = 3 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack quobyte-client[87010]: Reading configuration file: /etc/quobyte/client.cfg Sep 03 20:00:03 devstack quobyte-client[87010]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.quobyte_volume_url = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.replication_device = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.report_discard_supported = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.reserved_percentage = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.target_helper = tgtadm {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.target_ip_address = 192.168.122.54 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.target_port = 3260 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.target_protocol = iscsi {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] CMD "mount.quobyte" returned: 1 in 0.153s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.trace_flags = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.unique_fqdn_network = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.use_chap_auth = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.volume_backend_name = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.volume_clear = zero {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.volume_clear_ionice = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.volume_clear_size = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_reports.file_event_handler = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_reports.log_dir = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.backend_availability_zone = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.backend_host = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.chap_password = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.chap_username = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.chiscsi_conf = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.disk_geometry = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.driver_client_cert = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.driver_data_namespace = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.driver_use_ssl = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.extra_capabilities = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.filter_function = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.goodness_function = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[87009]: INFO cinder.volume.drivers.quobyte [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae ... Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf -c /etc/quobyte/client-cinder.cfg {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.iser_helper = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.iser_ip_address = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.iser_port = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.iser_target_prefix = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.nas_host = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.nas_login = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.nas_mount_options = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.nas_password = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.nas_private_key = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.nas_share_path = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.nas_ssh_port = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.num_shell_tries = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.nvmet_port_id = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.replication_device = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.report_discard_supported = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.reserved_percentage = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.scst_target_driver = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.storage_protocol = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.target_helper = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.target_ip_address = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.target_port = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.target_prefix = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.target_protocol = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.trace_flags = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.use_chap_auth = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.volume_clear = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.volume_clear_size = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] QuobyteHD.volumes_dir = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.ssl = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack sudo[87013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf -c /etc/quobyte/client-cinder.cfg Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_notifications.driver = [] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_notifications.retry = -1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] key_manager.fixed_key = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.barbican_api_version = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.barbican_endpoint = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.barbican_endpoint_type = public {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.barbican_region_name = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.cafile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.certfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.collect_timing = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.insecure = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.keyfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.number_of_retries = 60 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.retry_delay = 1 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.send_service_user_token = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.split_loggers = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.timeout = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.tls_ciphers = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.tls_min_version = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.verify_ssl = True {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican.verify_ssl_path = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican_service_user.auth_section = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican_service_user.auth_type = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican_service_user.cafile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican_service_user.certfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican_service_user.collect_timing = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican_service_user.insecure = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican_service_user.keyfile = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican_service_user.split_loggers = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican_service_user.timeout = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican_service_user.tls_ciphers = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] barbican_service_user.tls_min_version = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.approle_role_id = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.approle_secret_id = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.auth_method = approle {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.auth_path = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.kv_mountpoint = secret {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.kv_path = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.kv_version = 2 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.namespace = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.root_token_id = **** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.ssl_ca_crt_file = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.timeout = 60.0 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.token_file = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.token_role = None {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.use_ssl = False {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:03 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] ******************************************************************************** {{(pid=86792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 20:00:03 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.409s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:00:03 devstack cinder-volume[87009]: INFO cinder.volume.drivers.quobyte [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae succeeded Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.430s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:00:03 devstack sudo[87084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:00:03 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:00:03 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.242s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:00:03 devstack cinder-volume[87009]: INFO cinder.volume.driver [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Driver hasn't implemented _init_vendor_properties() Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG cinder.volume.driver [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8243980407715, 'free_capacity_gb': 1773.8243980407715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87009) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG oslo_db.sqlalchemy.engines [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87009) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writer thread running {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 20:00:03 devstack cinder-volume[87009]: DEBUG cinder.db.api [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Building query based on filter {{(pid=87009) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87009) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 20:00:04 devstack cinder-volume[87009]: INFO cinder.keymgr.migration [None req-7a083ed9-947b-4c85-b9df-2697dec673d0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:00:04 devstack sudo[87088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:00:04 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:00:04 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.234s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:00:04 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Driver initialization completed successfully. Sep 03 20:00:04 devstack cinder-volume[87009]: INFO cinder.manager [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Initiating service 3 cleanup Sep 03 20:00:04 devstack cinder-volume[87009]: INFO cinder.manager [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Service 3 cleanup completed. Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG cinder.service [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Creating RPC server for service cinder-volume {{(pid=87009) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG cinder.service [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87009) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 20:00:04 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:00:04 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:00:04 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:00:04 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Sep 03 20:00:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.278s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:00:04 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a1751cc0-952b-4dd4-91d7-93f439b4e924 None None] Driver post RPC initialization completed successfully. Sep 03 20:00:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6caee301-8ebf-45ed-958b-221b0b9f733c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:00:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6caee301-8ebf-45ed-958b-221b0b9f733c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:00:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6caee301-8ebf-45ed-958b-221b0b9f733c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:00:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6caee301-8ebf-45ed-958b-221b0b9f733c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:00:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6caee301-8ebf-45ed-958b-221b0b9f733c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:00:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6caee301-8ebf-45ed-958b-221b0b9f733c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:00:09 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:00:09 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:00:09 devstack cinder-volume[86792]: INFO oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Caught SIGTERM, stopping children Sep 03 20:00:09 devstack cinder-volume[86792]: DEBUG oslo_concurrency.lockutils [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Acquiring lock "singleton_lock" {{(pid=86792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 20:00:09 devstack cinder-volume[86792]: DEBUG oslo_concurrency.lockutils [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Acquired lock "singleton_lock" {{(pid=86792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 20:00:09 devstack cinder-volume[86792]: DEBUG oslo_concurrency.lockutils [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Releasing lock "singleton_lock" {{(pid=86792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 20:00:09 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Stop services. {{(pid=86792) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 03 20:00:09 devstack cinder-volume[86792]: DEBUG oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Killing children. {{(pid=86792) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 03 20:00:09 devstack cinder-volume[86792]: INFO oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Waiting on 1 children to exit Sep 03 20:00:09 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Sep 03 20:00:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6caee301-8ebf-45ed-958b-221b0b9f733c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.253s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:00:09 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-6caee301-8ebf-45ed-958b-221b0b9f733c None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6caee301-8ebf-45ed-958b-221b0b9f733c None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6caee301-8ebf-45ed-958b-221b0b9f733c None None] Unable to connect to AMQP server on 192.168.122.54:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server [None req-6caee301-8ebf-45ed-958b-221b0b9f733c None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.54:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server method() Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server return _publish( Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server listener(*args) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.54:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 03 20:00:09 devstack cinder-volume[87009]: ERROR oslo_messaging.rpc.server Sep 03 20:00:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Acquiring lock "singleton_lock" {{(pid=87009) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 20:00:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Acquired lock "singleton_lock" {{(pid=87009) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 20:00:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Releasing lock "singleton_lock" {{(pid=87009) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 20:00:12 devstack cinder-volume[87009]: WARNING amqp [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 20:00:12 devstack cinder-volume[87009]: WARNING amqp [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 20:00:12 devstack cinder-volume[86792]: INFO oslo_service.backend._eventlet.service [None req-035d472b-9a7f-434b-90b2-caab2365500d None None] Child 87009 exited with status 0 Sep 03 20:00:13 devstack cinder-volume[87295]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 20:00:13 devstack cinder-volume[87295]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 20:00:13 devstack cinder-volume[87295]: we strongly recommend against using it for new projects. Sep 03 20:00:13 devstack cinder-volume[87295]: If you are already using Eventlet, we recommend migrating to a different Sep 03 20:00:13 devstack cinder-volume[87295]: framework. For more detail see Sep 03 20:00:13 devstack cinder-volume[87295]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 20:00:13 devstack cinder-volume[87295]: import eventlet # noqa Sep 03 20:00:16 devstack cinder-volume[87295]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87295) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 20:00:16 devstack cinder-volume[87295]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87295) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 20:00:16 devstack cinder-volume[87295]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87295) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 20:00:16 devstack cinder-volume[87295]: INFO dbcounter [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] Registered counter for database cinder Sep 03 20:00:16 devstack cinder-volume[87295]: DEBUG oslo_db.sqlalchemy.engines [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87295) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG dbcounter [-] [87295] Writer thread running {{(pid=87295) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 20:00:17 devstack cinder-volume[87295]: INFO cinder.rpc [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 20:00:17 devstack cinder-volume[87295]: INFO cinder.rpc [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_db.sqlalchemy.engines [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87295) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 20:00:17 devstack cinder-volume[87295]: INFO cinder.volume.manager [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] Determined volume DB was empty at startup. Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG cinder.volume.manager [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87295) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 20:00:17 devstack cinder-volume[87295]: WARNING stevedore.named [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 20:00:17 devstack cinder-volume[87295]: WARNING castellan.key_manager [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 20:00:17 devstack cinder-volume[87295]: WARNING cinder.keymgr.conf_key_mgr [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 20:00:17 devstack cinder-volume[87295]: INFO cinder.volume.manager [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_db.sqlalchemy.engines [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87295) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 20:00:17 devstack cinder-volume[87295]: INFO oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] Starting 1 workers Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] Started child 87582 {{(pid=87295) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] Full set of CONF: {{(pid=87295) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] ******************************************************************************** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] Configuration options gathered from: {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] ================================================================================ {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] allow_availability_zone_fallback = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] allow_compression_on_image_upload = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] allowed_direct_url_schemes = [] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] api_rate_limit = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] auth_strategy = keystone {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_availability_zone = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_host = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_name = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_stats_polling_interval = 60 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backup_api_class = cinder.backup.api.API {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backup_name_template = backup-%s {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backup_use_same_host = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backup_use_temp_snapshot = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] chap_password = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87582]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] chap_username = {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cinder_internal_tenant_project_id = a2dfd78e79b74922b850fe72c517cf0e {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cinder_internal_tenant_user_id = a0284a3c215447909a4881d871437ecf {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cluster = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] compression_format = gzip {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] compute_api_class = cinder.compute.nova.API {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] config_dir = [] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] config_source = [] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] control_exchange = openstack {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] debug = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] default_availability_zone = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] default_group_type = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] default_volume_type = QuobyteHD {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] disk_geometry = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] driver_client_cert = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] driver_client_cert_key = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] driver_data_namespace = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] driver_ssl_cert_path = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] driver_ssl_cert_verify = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] driver_use_ssl = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] enable_new_services = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] enable_unsupported_driver = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] enabled_backends = ['QuobyteHD'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] enforce_multipath_for_image_xfer = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] filter_function = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance_api_insecure = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance_api_servers = ['http://192.168.122.54/image'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance_api_ssl_compression = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance_ca_certificates_file = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance_catalog_info = image:glance:publicURL {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance_certfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance_keyfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance_num_retries = 3 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance_request_timeout = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] goodness_function = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] graceful_shutdown_timeout = 5 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] group_api_class = cinder.group.api.API {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] host = devstack {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] image_compress_on_upload = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] image_conversion_address_space_limit = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] image_conversion_cpu_limit = 60 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] image_conversion_disable = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] image_upload_use_cinder_backend = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] image_upload_use_internal_tenant = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] image_volume_cache_enabled = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] image_volume_cache_max_count = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] image_volume_cache_max_size_gb = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] init_host_max_objects_retrieval = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] instance_format = [instance: %(uuid)s] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] iscsi_target_flags = {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] iscsi_write_cache = on {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] iser_helper = tgtadm {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] iser_ip_address = 192.168.122.54 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] iser_port = 3260 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] log_color = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] log_config_append = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] log_dir = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] log_file = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] log_options = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] log_rotate_interval = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] log_rotate_interval_type = days {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] log_rotation_type = none {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] max_age = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] max_logfile_count = 30 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] max_logfile_size_mb = 200 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] max_over_subscription_ratio = 20.0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] message_reap_interval = 86400 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] message_ttl = 2592000 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] migration_create_volume_timeout_secs = 300 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] monkey_patch = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] monkey_patch_modules = [] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] my_ip = 192.168.122.54 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] no_snapshot_gb_quota = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] num_iser_scan_tries = 3 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] num_shell_tries = 3 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] num_volume_device_scan_tries = 3 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] nvmeof_conn_info_version = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] nvmet_ns_id = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] nvmet_port_id = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] osapi_max_limit = 1000 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] osapi_volume_ext_list = [] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] osapi_volume_listen = 0.0.0.0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] osapi_volume_listen_port = 8776 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] osapi_volume_use_ssl = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] osapi_volume_workers = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] per_volume_size_limit = -1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] periodic_fuzzy_delay = 60 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] periodic_interval = 60 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] project_id_regex = [0-9a-f\-]+ {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] public_endpoint = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] publish_errors = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] quota_backup_gigabytes = 1000 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] quota_backups = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] quota_gigabytes = 1000 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] quota_groups = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] quota_snapshots = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] quota_volumes = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] rate_limit_burst = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] rate_limit_except_level = CRITICAL {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] rate_limit_interval = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] reinit_driver_count = 3 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] replication_device = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] report_discard_supported = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] report_interval = 120 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] reservation_clean_interval = 86400 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] reservation_expire = 86400 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] reserved_image_namespaces = [] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] reserved_percentage = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87582) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] rpc_response_timeout = 120 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] run_external_periodic_tasks = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] scst_target_driver = iscsi {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] scst_target_iqn_name = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] service_down_time = 720 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] shell_completion = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] snapshot_name_template = snapshot-%s {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] split_loggers = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] state_path = /opt/stack/data/cinder {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] storage_availability_zone = nova {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] storage_protocol = iSCSI {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] syslog_log_facility = LOG_USER {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] target_helper = lioadm {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] target_ip_address = 192.168.122.54 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] target_port = 3260 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] target_protocol = iscsi {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] target_secondary_ip_addresses = [] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] trace_flags = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] transfer_api_class = cinder.transfer.api.API {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] transport_url = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] until_refresh = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] use_chap_auth = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] use_default_quota_class = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] use_journal = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] use_json = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] use_multipath_for_image_xfer = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] use_stderr = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] use_syslog = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] verify_glance_signatures = enabled {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] volume_api_class = cinder.volume.api.API {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] volume_backend_name = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] volume_clear = zero {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] volume_clear_ionice = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] volume_clear_size = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] volume_copy_bps_limit = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] volume_dd_blocksize = 1M {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] volume_name_template = volume-%s {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] volume_service_inithost_offload = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] volume_usage_audit_period = month {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] zoning_mode = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_concurrency.disable_process_locking = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.auth_section = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.auth_type = password {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.auth_version = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.cache = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.certfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.delay_auth_decision = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.http_connect_timeout = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.include_service_catalog = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.insecure = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.interface = public {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.keyfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_password = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcache_username = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.region_name = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.service_token_roles_required = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.service_type = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.token_cache_time = 300 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.54/identity {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.backend = dogpile.cache.null {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.backend_argument = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.backend_expiration_time = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.config_prefix = cache.oslo {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.debug_cache_backend = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.enable_retry_client = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.enable_socket_keepalive = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.enabled = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.expiration_time = 600 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.hashclient_retry_attempts = 2 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.memcache_dead_retry = 300 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.memcache_pool_maxsize = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.memcache_sasl_enabled = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.password = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.proxies = [] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.redis_db = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.redis_sentinel_service_name = mymaster {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.redis_server = localhost:6379 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.retry_attempts = 2 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.retry_delay = 0.0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.socket_keepalive_count = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.socket_keepalive_idle = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.socket_keepalive_interval = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.socket_timeout = 1.0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.tls_allowed_ciphers = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.tls_cafile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.tls_certfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.tls_enabled = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.tls_keyfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cache.username = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] coordination.backend_url = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.asyncio_connection = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.asyncio_slave_connection = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.backend = sqlalchemy {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.connection = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.connection_debug = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.connection_parameters = {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.connection_recycle_time = 3600 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.connection_trace = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.db_inc_retry_interval = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.db_max_retries = 20 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.db_max_retry_interval = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.db_retry_interval = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.max_overflow = 50 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.max_pool_size = 5 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.max_retries = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.mysql_wsrep_sync_wait = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.pool_timeout = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.retry_interval = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.slave_connection = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.sqlite_synchronous = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.synchronous_reader = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] database.use_db_reconnect = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_tracing.insecure = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler.connection_string = messaging:// {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler.enabled = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler.es_doc_type = notification {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler.es_scroll_size = 10000 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler.es_scroll_time = 2m {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler.filter_error_trace = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler.hmac_keys = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler.sentinel_service_name = mymaster {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler.socket_timeout = 0.1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler.trace_requests = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler.trace_sqlalchemy = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler_jaeger.process_tags = {} {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler_jaeger.service_name_prefix = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] profiler_otlp.service_name_prefix = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_policy.enforce_new_defaults = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_policy.policy_default_rule = default {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_policy.policy_file = policy.yaml {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_policy.remote_timeout = 60.0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] privsep_osbrick.group = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] privsep_osbrick.helper_command = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87582) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 03 20:00:17 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.quobyte [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 03 20:00:17 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.quobyte [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] privsep_osbrick.user = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cinder_sys_admin.group = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cinder_sys_admin.helper_command = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] cinder_sys_admin.user = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] service_user.auth_section = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Running cmd (subprocess): mount.quobyte {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] service_user.auth_type = password {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] service_user.cafile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] service_user.certfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] service_user.collect_timing = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] service_user.insecure = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] service_user.keyfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] service_user.send_service_user_token = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] service_user.split_loggers = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] service_user.timeout = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] service_user.tls_ciphers = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] service_user.tls_min_version = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance.auth_section = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance.auth_type = password {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance.certfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance.collect_timing = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance.insecure = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance.keyfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance.region_name = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance.split_loggers = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance.timeout = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance.tls_ciphers = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] glance.tls_min_version = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.backend_availability_zone = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.chap_password = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.chap_username = {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.disk_geometry = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.driver_client_cert = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.driver_client_cert_key = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.driver_data_namespace = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.driver_use_ssl = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.enable_unsupported_driver = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.extra_capabilities = {} {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.filter_function = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.goodness_function = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.iscsi_target_flags = {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.iscsi_write_cache = on {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.iser_helper = tgtadm {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.iser_ip_address = 192.168.122.54 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.iser_port = 3260 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.nas_host = {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.nas_login = admin {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.nas_mount_options = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.nas_password = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.nas_private_key = {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.nas_share_path = {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.nas_ssh_port = 22 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.num_shell_tries = 3 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.nvmet_port_id = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.quobyte_client_cfg = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.quobyte_volume_url = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.replication_device = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.report_discard_supported = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.reserved_percentage = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.scst_target_driver = iscsi {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.scst_target_iqn_name = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.storage_protocol = iSCSI {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack quobyte-client[87585]: Reading configuration file: /etc/quobyte/client.cfg Sep 03 20:00:17 devstack quobyte-client[87585]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.target_helper = tgtadm {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.target_ip_address = 192.168.122.54 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.target_port = 3260 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.target_protocol = iscsi {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.trace_flags = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.unique_fqdn_network = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.use_chap_auth = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:00:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:00:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.volume_backend_name = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.volume_clear = zero {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.volume_clear_ionice = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.volume_clear_size = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_reports.file_event_handler = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_reports.log_dir = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.backend_availability_zone = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.backend_host = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.chap_password = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.chap_username = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.chiscsi_conf = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.disk_geometry = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.driver_client_cert = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.driver_client_cert_key = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.driver_data_namespace = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.driver_use_ssl = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.extra_capabilities = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.filter_function = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.goodness_function = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.iscsi_target_flags = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.iscsi_write_cache = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.iser_helper = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.iser_ip_address = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.iser_port = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.iser_target_prefix = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.nas_host = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.nas_login = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.nas_mount_options = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.nas_password = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.nas_private_key = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.nas_share_path = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.nas_ssh_port = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.num_shell_tries = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.nvmet_ns_id = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.nvmet_port_id = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.replication_device = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.report_discard_supported = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.reserved_percentage = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.scst_target_driver = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.storage_protocol = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.target_helper = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.target_ip_address = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.target_port = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.target_prefix = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.target_protocol = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.trace_flags = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.unique_fqdn_network = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.use_chap_auth = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.volume_clear = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.volume_clear_ionice = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.volume_clear_size = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] QuobyteHD.volumes_dir = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:00:17 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.ssl = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.ssl_version = {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_notifications.driver = [] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_notifications.retry = -1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] oslo_messaging_notifications.transport_url = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] key_manager.fixed_key = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.barbican_api_version = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.barbican_endpoint = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.barbican_endpoint_type = public {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.barbican_region_name = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.cafile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.certfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.collect_timing = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.insecure = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.keyfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.number_of_retries = 60 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.retry_delay = 1 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.send_service_user_token = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.split_loggers = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.timeout = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.tls_ciphers = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.tls_min_version = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.verify_ssl = True {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican.verify_ssl_path = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican_service_user.auth_section = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican_service_user.auth_type = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican_service_user.cafile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican_service_user.certfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican_service_user.collect_timing = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican_service_user.insecure = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican_service_user.keyfile = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican_service_user.split_loggers = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican_service_user.timeout = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican_service_user.tls_ciphers = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] barbican_service_user.tls_min_version = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.approle_role_id = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.approle_secret_id = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.auth_method = approle {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.auth_path = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.kv_mountpoint = secret {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.kv_path = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.kv_version = 2 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.namespace = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.root_token_id = **** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.ssl_ca_crt_file = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.timeout = 60.0 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.token_file = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.token_role = None {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.use_ssl = False {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 20:00:17 devstack cinder-volume[87295]: DEBUG oslo_service.backend._eventlet.service [None req-fcc59feb-dc08-414d-b007-390ec5ede96e None None] ******************************************************************************** {{(pid=87295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 20:00:17 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Sep 03 20:00:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.259s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:00:17 devstack cinder-volume[87582]: INFO cinder.volume.driver [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Driver hasn't implemented _init_vendor_properties() Sep 03 20:00:17 devstack cinder-volume[87582]: DEBUG cinder.volume.driver [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8243980407715, 'free_capacity_gb': 1773.8243980407715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87582) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG oslo_db.sqlalchemy.engines [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87582) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writer thread running {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG cinder.db.api [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Building query based on filter {{(pid=87582) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87582) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:00:18 devstack cinder-volume[87582]: INFO cinder.keymgr.migration [None req-23370469-ef6a-4f50-8355-b4363fbe7bec None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 20:00:18 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:00:18 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:00:18 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.245s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:00:18 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Driver initialization completed successfully. Sep 03 20:00:18 devstack cinder-volume[87582]: INFO cinder.manager [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Initiating service 3 cleanup Sep 03 20:00:18 devstack cinder-volume[87582]: INFO cinder.manager [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Service 3 cleanup completed. Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG cinder.service [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Creating RPC server for service cinder-volume {{(pid=87582) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG cinder.service [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87582) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 20:00:18 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:00:18 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:00:18 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:00:18 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Sep 03 20:00:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.248s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:00:18 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-35b3461e-c688-461c-99de-b7d1b233c5d6 None None] Driver post RPC initialization completed successfully. Sep 03 20:00:27 devstack cinder-volume[87295]: DEBUG dbcounter [-] [87295] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87295) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:00:28 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=3 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:00:28 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:00:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:00:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 6 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:00:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:01:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:01:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:01:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:01:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:01:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:01:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:01:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:01:36 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:01:36 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:01:37 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Sep 03 20:01:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.827s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:01:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:01:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:01:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 6 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:01:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Flow 'volume_create_manager' (ac6b3f58-d1d8-4e5c-8377-637e19585076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2161a2-6b54-4c2e-9807-6e37545aa0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2161a2-6b54-4c2e-9807-6e37545aa0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-647652425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb851aaf-8150-4d41-b91a-b54670aa734d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8fa227682e4f8291322847ea0ef394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:01:52Z,use_quota=True,user_id='41a88b3376c24cb9a37f28f0232a59fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bde46d5-2252-46ce-acf0-1bb85e5802eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bde46d5-2252-46ce-acf0-1bb85e5802eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507a6c40-c5d2-47f1-9442-186ccdf26c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507a6c40-c5d2-47f1-9442-186ccdf26c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb851aaf-8150-4d41-b91a-b54670aa734d', 'volume_name': 'volume-eb851aaf-8150-4d41-b91a-b54670aa734d', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd1e66e-6451-4fb4-84f2-a7ea0d75c932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd1e66e-6451-4fb4-84f2-a7ea0d75c932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d4989f-41e8-442b-8d80-fc952c478f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:01:52 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Volume eb851aaf-8150-4d41-b91a-b54670aa734d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb851aaf-8150-4d41-b91a-b54670aa734d', 'volume_size': 1} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-647652425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb851aaf-8150-4d41-b91a-b54670aa734d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8fa227682e4f8291322847ea0ef394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:01:52Z,use_quota=True,user_id='41a88b3376c24cb9a37f28f0232a59fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Creating volume eb851aaf-8150-4d41-b91a-b54670aa734d {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:01:52 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:01:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb851aaf-8150-4d41-b91a-b54670aa734d 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:01:52 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb851aaf-8150-4d41-b91a-b54670aa734d 1073741824 Sep 03 20:01:52 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:01:53 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Sep 03 20:01:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb851aaf-8150-4d41-b91a-b54670aa734d 1073741824" returned: 0 in 1.314s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:01:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb851aaf-8150-4d41-b91a-b54670aa734d {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:01:53 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb851aaf-8150-4d41-b91a-b54670aa734d Sep 03 20:01:53 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:01:54 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Sep 03 20:01:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb851aaf-8150-4d41-b91a-b54670aa734d" returned: 0 in 0.502s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:01:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:01:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:01:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d4989f-41e8-442b-8d80-fc952c478f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb851aaf-8150-4d41-b91a-b54670aa734d', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:01:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7ab356-e225-4391-ab0e-9f3a905f2e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:01:54 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Volume volume-eb851aaf-8150-4d41-b91a-b54670aa734d (eb851aaf-8150-4d41-b91a-b54670aa734d): created successfully Sep 03 20:01:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7ab356-e225-4391-ab0e-9f3a905f2e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:01:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Flow 'volume_create_manager' (ac6b3f58-d1d8-4e5c-8377-637e19585076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:01:54 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8c789a1d-05fa-4bf4-bce9-ebed881002f8 tempest-VolumesAdminNegativeTest-1358621692 None] Created volume successfully. Sep 03 20:01:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Acquiring lock "cinder-eb851aaf-8150-4d41-b91a-b54670aa734d-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:01:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Lock "cinder-eb851aaf-8150-4d41-b91a-b54670aa734d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:01:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Acquiring lock "cinder-quobyte-eb851aaf-8150-4d41-b91a-b54670aa734d" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:01:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Lock "cinder-quobyte-eb851aaf-8150-4d41-b91a-b54670aa734d" acquired by "delete_volume" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:01:57 devstack cinder-volume[87582]: INFO oslo.privsep.daemon [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_oxs6qyh/privsep.sock'] Sep 03 20:01:57 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_oxs6qyh/privsep.sock Sep 03 20:01:57 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:01:59 devstack cinder-volume[87582]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 03 20:01:59 devstack cinder-volume[87582]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 20:01:59 devstack cinder-volume[87582]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 03 20:01:59 devstack cinder-volume[87582]: WARNING oslo.privsep.daemon [-] privsep log: Sep 03 20:01:59 devstack cinder-volume[87582]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 03 20:01:59 devstack cinder-volume[87582]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 03 20:01:59 devstack cinder-volume[87582]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 20:01:59 devstack cinder-volume[87582]: WARNING oslo.privsep.daemon [-] privsep log: Sep 03 20:01:59 devstack cinder-volume[87582]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 03 20:02:00 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:00 devstack cinder-volume[87582]: INFO oslo.privsep.daemon [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Spawned new privsep daemon via rootwrap Sep 03 20:02:00 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Accepted privsep connection to /tmp/tmp_oxs6qyh/privsep.sock {{(pid=87582) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 03 20:02:00 devstack cinder-volume[87582]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 03 20:02:00 devstack cinder-volume[87582]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 03 20:02:00 devstack cinder-volume[87582]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 03 20:02:00 devstack cinder-volume[87582]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89028 Sep 03 20:02:00 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[809b241b-6a7b-4ef0-85af-8cdb7951dc19]: (2,) {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:02:00 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6342348d-1b3c-4b96-8c0f-40e3ce07306d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:02:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb851aaf-8150-4d41-b91a-b54670aa734d {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:01 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb851aaf-8150-4d41-b91a-b54670aa734d Sep 03 20:02:01 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:01 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb851aaf-8150-4d41-b91a-b54670aa734d" returned: 0 in 1.057s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb851aaf-8150-4d41-b91a-b54670aa734d {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:01 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb851aaf-8150-4d41-b91a-b54670aa734d Sep 03 20:02:01 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:02 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb851aaf-8150-4d41-b91a-b54670aa734d" returned: 0 in 0.727s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:02 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Lock "cinder-quobyte-eb851aaf-8150-4d41-b91a-b54670aa734d" released by "delete_volume" :: held 4.823s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:02:02 devstack cinder-volume[87582]: WARNING cinder.quota [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:02:02 devstack cinder-volume[87582]: WARNING cinder.quota [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:02:02 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Created reservations ['630db280-caf7-4ffe-be7f-64113f27a888', 'b9a79303-77ca-4fc8-85f6-990cd16d57e1', 'ad976af2-ef61-4b55-a00b-5cc937a7bf54', '651afa92-513e-4aec-a4be-5ded2e9db006'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:02:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:02:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:02:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:03 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:02:03 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Flow 'volume_create_manager' (50d952c7-0c07-49c7-acbf-2cacc8d85f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2310988f-46a7-4c7c-b0f9-261377e075ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2310988f-46a7-4c7c-b0f9-261377e075ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1491162035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e3c044-4e6f-45e5-a388-54551bdfc054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f4d0fc3adb4458830cf5ea296dd0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:02:03Z,use_quota=True,user_id='4276bc6f98814e61a433ceaed9afd020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ae43dd-7d83-4338-b808-1709891e7b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ae43dd-7d83-4338-b808-1709891e7b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76847d50-ee7a-4506-8a3d-7fcba419ecf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76847d50-ee7a-4506-8a3d-7fcba419ecf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e3c044-4e6f-45e5-a388-54551bdfc054', 'volume_name': 'volume-15e3c044-4e6f-45e5-a388-54551bdfc054', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b87b43-d79b-46c8-a3fd-88edd9464b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:03 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b87b43-d79b-46c8-a3fd-88edd9464b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a831a51-4ed2-4e10-9a42-875b0d3203da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:03 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Volume 15e3c044-4e6f-45e5-a388-54551bdfc054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e3c044-4e6f-45e5-a388-54551bdfc054', 'volume_size': 1} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1491162035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e3c044-4e6f-45e5-a388-54551bdfc054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f4d0fc3adb4458830cf5ea296dd0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:02:03Z,use_quota=True,user_id='4276bc6f98814e61a433ceaed9afd020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Creating volume 15e3c044-4e6f-45e5-a388-54551bdfc054 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:02:03 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-15e3c044-4e6f-45e5-a388-54551bdfc054 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.648s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:02:03 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Deleted volume successfully. Sep 03 20:02:03 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-15e3c044-4e6f-45e5-a388-54551bdfc054 1073741824 Sep 03 20:02:03 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Flow 'volume_create_manager' (83ce9a84-aee0-491a-93d8-3bba3d434106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c78058-9d34-4a21-89fa-5c9b88205f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c78058-9d34-4a21-89fa-5c9b88205f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1920010691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470d8330-60fa-41e1-8c1a-ad193d01bd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a608d0affc84e2ead5d7e9419bf94cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:02:04Z,use_quota=True,user_id='c253ebc1d0764740acac26e4da2b6d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59069fb-a85b-4722-858f-6d9a1e1801b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59069fb-a85b-4722-858f-6d9a1e1801b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867375f3-f004-41bd-9664-31c6b1054896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867375f3-f004-41bd-9664-31c6b1054896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '470d8330-60fa-41e1-8c1a-ad193d01bd0f', 'volume_name': 'volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb6cb19-9766-4b95-b369-604b18efe03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb6cb19-9766-4b95-b369-604b18efe03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e63b3d9-6a59-44ec-ab85-f8b3506826e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:04 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Volume 470d8330-60fa-41e1-8c1a-ad193d01bd0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f', 'volume_size': 1} Sep 03 20:02:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bb33ac7d-e95f-428f-9fe6-189d76baf2d4 tempest-VolumesAdminNegativeTest-1358621692 None] Lock "cinder-eb851aaf-8150-4d41-b91a-b54670aa734d-delete_volume" released by "delete_volume" :: held 6.596s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:02:04 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-15e3c044-4e6f-45e5-a388-54551bdfc054 1073741824" returned: 0 in 0.964s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-15e3c044-4e6f-45e5-a388-54551bdfc054 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:04 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-15e3c044-4e6f-45e5-a388-54551bdfc054 Sep 03 20:02:04 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:05 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-15e3c044-4e6f-45e5-a388-54551bdfc054" returned: 0 in 0.708s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.229s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1920010691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470d8330-60fa-41e1-8c1a-ad193d01bd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a608d0affc84e2ead5d7e9419bf94cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:02:04Z,use_quota=True,user_id='c253ebc1d0764740acac26e4da2b6d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Creating volume 470d8330-60fa-41e1-8c1a-ad193d01bd0f {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:02:05 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:05 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f 1073741824 Sep 03 20:02:05 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a831a51-4ed2-4e10-9a42-875b0d3203da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e3c044-4e6f-45e5-a388-54551bdfc054', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00013ddf-35f9-4503-b31c-bc0e9b01fc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:05 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Volume volume-15e3c044-4e6f-45e5-a388-54551bdfc054 (15e3c044-4e6f-45e5-a388-54551bdfc054): created successfully Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00013ddf-35f9-4503-b31c-bc0e9b01fc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Flow 'volume_create_manager' (50d952c7-0c07-49c7-acbf-2cacc8d85f90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:02:05 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b7437d5a-1710-4cd7-b2a7-0fe47683aea6 tempest-ServerRescueNegativeTestJSON-77111230 None] Created volume successfully. Sep 03 20:02:06 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f 1073741824" returned: 0 in 0.736s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:06 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f Sep 03 20:02:06 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:06 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f" returned: 0 in 0.843s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:02:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e63b3d9-6a59-44ec-ab85-f8b3506826e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b0bd37-707b-4344-9893-eb1fc6179c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:07 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Volume volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f (470d8330-60fa-41e1-8c1a-ad193d01bd0f): created successfully Sep 03 20:02:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b0bd37-707b-4344-9893-eb1fc6179c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Flow 'volume_create_manager' (83ce9a84-aee0-491a-93d8-3bba3d434106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:02:07 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6db1be66-4862-4832-bff7-7efec1caba3a tempest-ServersNegativeTestJSON-696885400 None] Created volume successfully. Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Flow 'volume_create_manager' (03a4c6d4-3c94-42f0-8f05-051116168919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ff002c-6eb2-40e5-a7c5-69cd238f380a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ff002c-6eb2-40e5-a7c5-69cd238f380a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1805510303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa02b81-e9cf-452c-8178-f2b953d87674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a608d0affc84e2ead5d7e9419bf94cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:02:11Z,use_quota=True,user_id='c253ebc1d0764740acac26e4da2b6d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf20694b-717a-4315-acb4-de622a582fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf20694b-717a-4315-acb4-de622a582fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893174a4-1726-46ca-a3dd-cf53eaac9fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893174a4-1726-46ca-a3dd-cf53eaac9fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa02b81-e9cf-452c-8178-f2b953d87674', 'volume_name': 'volume-2fa02b81-e9cf-452c-8178-f2b953d87674', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc02d12-c676-4a0d-894c-3618cc632cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc02d12-c676-4a0d-894c-3618cc632cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d445f57-417b-4c2f-a910-b8eac7b053c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:10 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Volume 2fa02b81-e9cf-452c-8178-f2b953d87674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa02b81-e9cf-452c-8178-f2b953d87674', 'volume_size': 1} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1805510303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa02b81-e9cf-452c-8178-f2b953d87674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a608d0affc84e2ead5d7e9419bf94cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:02:11Z,use_quota=True,user_id='c253ebc1d0764740acac26e4da2b6d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Creating volume 2fa02b81-e9cf-452c-8178-f2b953d87674 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:02:10 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:02:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2fa02b81-e9cf-452c-8178-f2b953d87674 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:11 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2fa02b81-e9cf-452c-8178-f2b953d87674 1073741824 Sep 03 20:02:11 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:11 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2fa02b81-e9cf-452c-8178-f2b953d87674 1073741824" returned: 0 in 1.046s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2fa02b81-e9cf-452c-8178-f2b953d87674 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:12 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2fa02b81-e9cf-452c-8178-f2b953d87674 Sep 03 20:02:12 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:12 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2fa02b81-e9cf-452c-8178-f2b953d87674" returned: 0 in 0.471s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:02:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d445f57-417b-4c2f-a910-b8eac7b053c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa02b81-e9cf-452c-8178-f2b953d87674', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83599022-ddc2-41a7-8136-f77e7b0dba24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:12 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Volume volume-2fa02b81-e9cf-452c-8178-f2b953d87674 (2fa02b81-e9cf-452c-8178-f2b953d87674): created successfully Sep 03 20:02:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83599022-ddc2-41a7-8136-f77e7b0dba24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Flow 'volume_create_manager' (03a4c6d4-3c94-42f0-8f05-051116168919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:02:12 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e434ddc1-a612-4567-88d1-c2886a987573 tempest-ServersNegativeTestJSON-696885400 None] Created volume successfully. Sep 03 20:02:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Acquiring lock "cinder-2fa02b81-e9cf-452c-8178-f2b953d87674-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:02:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Lock "cinder-2fa02b81-e9cf-452c-8178-f2b953d87674-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:02:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Acquiring lock "cinder-quobyte-2fa02b81-e9cf-452c-8178-f2b953d87674" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:02:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Lock "cinder-quobyte-2fa02b81-e9cf-452c-8178-f2b953d87674" acquired by "delete_volume" :: waited 0.054s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:02:15 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[710cf637-c0c0-41f9-9dde-2ed5019ee37c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:02:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2fa02b81-e9cf-452c-8178-f2b953d87674 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:16 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2fa02b81-e9cf-452c-8178-f2b953d87674 Sep 03 20:02:16 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:16 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2fa02b81-e9cf-452c-8178-f2b953d87674" returned: 0 in 0.640s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2fa02b81-e9cf-452c-8178-f2b953d87674 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:16 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2fa02b81-e9cf-452c-8178-f2b953d87674 Sep 03 20:02:16 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:17 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2fa02b81-e9cf-452c-8178-f2b953d87674" returned: 0 in 0.566s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Lock "cinder-quobyte-2fa02b81-e9cf-452c-8178-f2b953d87674" released by "delete_volume" :: held 1.295s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:02:17 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Created reservations ['0f7735ab-9913-4956-86fa-d4be8ace1804', 'b96bda9b-f0ad-4818-8699-af193af8464d', 'f2cccad0-1f5f-41e4-a3f6-615522954779', 'e124be53-d1fe-4e3e-8d5a-ca1854a74492'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:02:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:02:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:02:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:17 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:02:17 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:17 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.283s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:17 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:02:17 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Deleted volume successfully. Sep 03 20:02:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c7883b0-4bfe-408c-a8fc-956fbe6c62f4 tempest-ServersNegativeTestJSON-696885400 None] Lock "cinder-2fa02b81-e9cf-452c-8178-f2b953d87674-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:02:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Acquiring lock "cinder-470d8330-60fa-41e1-8c1a-ad193d01bd0f-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:02:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Lock "cinder-470d8330-60fa-41e1-8c1a-ad193d01bd0f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:02:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Acquiring lock "cinder-quobyte-470d8330-60fa-41e1-8c1a-ad193d01bd0f" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:02:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Lock "cinder-quobyte-470d8330-60fa-41e1-8c1a-ad193d01bd0f" acquired by "delete_volume" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:02:18 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60453e9-76b6-4b36-8ed7-91c69548bf77]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:02:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:18 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f Sep 03 20:02:18 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:18 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f" returned: 0 in 0.491s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:18 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f Sep 03 20:02:18 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:19 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-470d8330-60fa-41e1-8c1a-ad193d01bd0f" returned: 0 in 0.499s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Lock "cinder-quobyte-470d8330-60fa-41e1-8c1a-ad193d01bd0f" released by "delete_volume" :: held 1.094s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:02:19 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Created reservations ['64aafa45-d70d-4cbb-a4e9-b3532affb2fe', 'eb295fce-7090-4d00-905b-307bd6afd479', '53f074fd-c1ba-46f8-bcfc-140c4dba690e', '4381368d-59a8-454e-9bf1-4ddbaec8ccfb'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:02:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:02:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:02:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:19 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:02:19 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:20 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.466s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:20 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:02:20 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Deleted volume successfully. Sep 03 20:02:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a2b5c1cf-54b1-4e5b-be55-830d97a0f74d tempest-ServersNegativeTestJSON-696885400 None] Lock "cinder-470d8330-60fa-41e1-8c1a-ad193d01bd0f-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:02:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Acquiring lock "cinder-15e3c044-4e6f-45e5-a388-54551bdfc054-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:02:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Lock "cinder-15e3c044-4e6f-45e5-a388-54551bdfc054-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:02:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Acquiring lock "cinder-quobyte-15e3c044-4e6f-45e5-a388-54551bdfc054" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:02:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Lock "cinder-quobyte-15e3c044-4e6f-45e5-a388-54551bdfc054" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:02:29 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6be3f8-e09e-4a0e-8270-66b496658073]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:02:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-15e3c044-4e6f-45e5-a388-54551bdfc054 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:29 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-15e3c044-4e6f-45e5-a388-54551bdfc054 Sep 03 20:02:29 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:30 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=25,cinder:UPDATE=40,cinder:INSERT=11,cinder:DELETE=6 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:02:30 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-15e3c044-4e6f-45e5-a388-54551bdfc054" returned: 0 in 0.658s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-15e3c044-4e6f-45e5-a388-54551bdfc054 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:30 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-15e3c044-4e6f-45e5-a388-54551bdfc054 Sep 03 20:02:30 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:30 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-15e3c044-4e6f-45e5-a388-54551bdfc054" returned: 0 in 0.733s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Lock "cinder-quobyte-15e3c044-4e6f-45e5-a388-54551bdfc054" released by "delete_volume" :: held 1.515s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:02:31 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Created reservations ['a4e3365b-ca67-4c11-9f6e-5095c9c0bd81', '301e8cd1-7e5e-4db0-b76c-4889c66fae03', '4db48b7a-c5e6-41c6-9938-b2b7cd3fd3c9', '43612915-d150-42a5-9d0a-64e3b1278eca'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:02:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:02:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:02:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:31 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:02:31 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:31 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.302s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:31 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:02:31 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Deleted volume successfully. Sep 03 20:02:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e1410f9d-138f-4b7b-b7c3-a058f1772fc1 tempest-ServerRescueNegativeTestJSON-77111230 None] Lock "cinder-15e3c044-4e6f-45e5-a388-54551bdfc054-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:02:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:02:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:02:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:02:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:36 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:02:36 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:37 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.350s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:02:41 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:02:41 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:UPDATE=42,cinder:SELECT=28,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:02:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5b85c494-c031-4a1e-94c1-77c07a2a663c tempest-BackendsCapabilitiesAdminTestsJSON-784695793 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8243980407715, 'free_capacity_gb': 1773.8243980407715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87582) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 20:02:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-25732e24-cf00-4138-a679-e3242ae982e5 tempest-BackendsCapabilitiesAdminTestsJSON-784695793 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8243980407715, 'free_capacity_gb': 1773.8243980407715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87582) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 20:02:45 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:02:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Flow 'volume_create_manager' (4e82c86e-7368-472b-ad85-05bef76c50ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:02:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64dae13-7d75-43ca-b803-75e82ca4fa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64dae13-7d75-43ca-b803-75e82ca4fa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1443047533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856346ad01f9414dafd3ed07f1c343c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:02:46Z,use_quota=True,user_id='c6774e059db14e61adf348068ed9c245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4752b9-159c-498d-9dd7-76c506a022c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4752b9-159c-498d-9dd7-76c506a022c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c85ead8e-a22d-465d-86d5-3dc32bb62968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c85ead8e-a22d-465d-86d5-3dc32bb62968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada', 'volume_name': 'volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a050fcf-f223-4acd-9a7e-58632e01c030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a050fcf-f223-4acd-9a7e-58632e01c030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356e6052-4a0b-4d1d-bfac-8fcdb38ef134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:46 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Volume 57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada', 'volume_size': 1} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1443047533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856346ad01f9414dafd3ed07f1c343c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:02:46Z,use_quota=True,user_id='c6774e059db14e61adf348068ed9c245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Creating volume 57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:02:46 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:46 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada 1073741824 Sep 03 20:02:46 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:46 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada 1073741824" returned: 0 in 0.526s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:46 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada Sep 03 20:02:46 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:46 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada" returned: 0 in 0.352s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356e6052-4a0b-4d1d-bfac-8fcdb38ef134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814c91ae-fef6-4ed0-8819-bd726c2ecebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:47 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Volume volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada (57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada): created successfully Sep 03 20:02:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814c91ae-fef6-4ed0-8819-bd726c2ecebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Flow 'volume_create_manager' (4e82c86e-7368-472b-ad85-05bef76c50ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:02:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d3b21ec3-1475-4710-ad92-91ce2eda3d3b tempest-DeleteServersTestJSON-2101927598 None] Created volume successfully. Sep 03 20:02:52 devstack cinder-volume[87582]: WARNING py.warnings [req-8410fcbe-57e5-49ed-a75d-a3e46d44a503 req-2dc36639-d145-4547-aa59-837aed80f4a8 tempest-DeleteServersTestJSON-2101927598 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 03 20:02:52 devstack cinder-volume[87582]: .first() Sep 03 20:02:52 devstack cinder-volume[87582]: Sep 03 20:02:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-8410fcbe-57e5-49ed-a75d-a3e46d44a503 req-2dc36639-d145-4547-aa59-837aed80f4a8 tempest-DeleteServersTestJSON-2101927598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-8410fcbe-57e5-49ed-a75d-a3e46d44a503 req-2dc36639-d145-4547-aa59-837aed80f4a8 tempest-DeleteServersTestJSON-2101927598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-8410fcbe-57e5-49ed-a75d-a3e46d44a503 req-2dc36639-d145-4547-aa59-837aed80f4a8 tempest-DeleteServersTestJSON-2101927598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-8410fcbe-57e5-49ed-a75d-a3e46d44a503 req-2dc36639-d145-4547-aa59-837aed80f4a8 tempest-DeleteServersTestJSON-2101927598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5119722f-8516-47e0-a665-587585de41e5', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:02:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-8410fcbe-57e5-49ed-a75d-a3e46d44a503 req-2dc36639-d145-4547-aa59-837aed80f4a8 tempest-DeleteServersTestJSON-2101927598 None] attachment_update completed successfully. Sep 03 20:02:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-94a9e2dc-af86-4c68-b7e5-5693ef6f0c84 tempest-GroupSnapshotsV319Test-954935653 None] Group tempest-GroupSnapshotsV319Test-Group-1884228126: creating Sep 03 20:02:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-94a9e2dc-af86-4c68-b7e5-5693ef6f0c84 tempest-GroupSnapshotsV319Test-954935653 None] Group tempest-GroupSnapshotsV319Test-Group-1884228126: created successfully Sep 03 20:02:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-94a9e2dc-af86-4c68-b7e5-5693ef6f0c84 tempest-GroupSnapshotsV319Test-954935653 None] Create group completed successfully. Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Flow 'volume_create_manager' (35589de0-800d-486a-bb79-807c9885d083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140f9c2d-0a21-4ed0-bf93-f271609690e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140f9c2d-0a21-4ed0-bf93-f271609690e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1112418793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56e18edb-4c72-44aa-9e6d-1156f74c2edb,host='devstack@QuobyteHD#QuobyteHD',id=132356b2-1841-4633-b020-db33a69ee9a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9004c97534d941b9b6748f27d6b229ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:02:58Z,use_quota=True,user_id='3fb0feecdf3d4c4a9084ae3313c513ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3267724b-205f-497e-b2e8-e68783a9cef3),volume_type_id=3267724b-205f-497e-b2e8-e68783a9cef3)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989baa2e-e9fa-4b00-b1a5-3e77cc966a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989baa2e-e9fa-4b00-b1a5-3e77cc966a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16355a44-371c-49c7-ab6a-6524d3b4e7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16355a44-371c-49c7-ab6a-6524d3b4e7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132356b2-1841-4633-b020-db33a69ee9a0', 'volume_name': 'volume-132356b2-1841-4633-b020-db33a69ee9a0', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797efb05-c75e-4452-9b85-2b13c192146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797efb05-c75e-4452-9b85-2b13c192146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63bd6dc2-bf6f-4c69-8b54-afb54d5885e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:58 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Volume 132356b2-1841-4633-b020-db33a69ee9a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132356b2-1841-4633-b020-db33a69ee9a0', 'volume_size': 1} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56e18edb-4c72-44aa-9e6d-1156f74c2edb,created_at=2026-09-03T18:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1112418793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56e18edb-4c72-44aa-9e6d-1156f74c2edb,host='devstack@QuobyteHD#QuobyteHD',id=132356b2-1841-4633-b020-db33a69ee9a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9004c97534d941b9b6748f27d6b229ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:02:58Z,use_quota=True,user_id='3fb0feecdf3d4c4a9084ae3313c513ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3267724b-205f-497e-b2e8-e68783a9cef3),volume_type_id=3267724b-205f-497e-b2e8-e68783a9cef3)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Creating volume 132356b2-1841-4633-b020-db33a69ee9a0 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:02:58 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:58 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0 1073741824 Sep 03 20:02:58 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:58 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0 1073741824" returned: 0 in 0.532s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:02:58 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0 Sep 03 20:02:58 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:02:59 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Sep 03 20:02:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0" returned: 0 in 0.281s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:02:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:02:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:02:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63bd6dc2-bf6f-4c69-8b54-afb54d5885e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132356b2-1841-4633-b020-db33a69ee9a0', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b4f81e-5d1c-46e8-b3e4-88c9deab294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:02:59 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Volume volume-132356b2-1841-4633-b020-db33a69ee9a0 (132356b2-1841-4633-b020-db33a69ee9a0): created successfully Sep 03 20:02:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b4f81e-5d1c-46e8-b3e4-88c9deab294b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:02:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Flow 'volume_create_manager' (35589de0-800d-486a-bb79-807c9885d083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:02:59 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c3afd74c-a7a1-4c79-96c7-0012739826df tempest-GroupSnapshotsV319Test-954935653 None] Created volume successfully. Sep 03 20:02:59 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-4598f55a-c753-4065-a80b-f96a179a6982 req-01ccb3ad-4332-4198-8295-6c27788ea7ea tempest-DeleteServersTestJSON-2101927598 None] Terminate volume connection completed successfully. Sep 03 20:02:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-4598f55a-c753-4065-a80b-f96a179a6982 req-01ccb3ad-4332-4198-8295-6c27788ea7ea tempest-DeleteServersTestJSON-2101927598 None] Deleting attachment 5119722f-8516-47e0-a665-587585de41e5. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:02:59 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] GroupSnapshot dcc7aefc-df5a-475a-bd06-dcc0a002bd1d: creating. Sep 03 20:03:00 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] Group snapshot dcc7aefc-df5a-475a-bd06-dcc0a002bd1d: creating. {{(pid=87582) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 20:03:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] Creating offline snapshot 83c180e4-e17d-4d02-972c-481cd384cac7 of volume 132356b2-1841-4633-b020-db33a69ee9a0 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:03:00 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfe9d01-d75b-44b7-b453-cff240a5c331]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:03:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:00 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0 Sep 03 20:03:00 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:00 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0" returned: 0 in 0.470s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:00 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 1G Sep 03 20:03:00 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:01 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 1G" returned: 0 in 0.597s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132356b2-1841-4633-b020-db33a69ee9a0 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:01 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132356b2-1841-4633-b020-db33a69ee9a0 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 Sep 03 20:03:01 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:01 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132356b2-1841-4633-b020-db33a69ee9a0 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7" returned: 0 in 0.423s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:01 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:03:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:01 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 Sep 03 20:03:01 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:01 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7" returned: 0 in 0.306s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:01 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.info Sep 03 20:03:01 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:02 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.info" returned: 0 in 0.335s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:02 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:03:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:02 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.info Sep 03 20:03:02 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:02 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.info" returned: 0 in 0.454s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.703s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:02 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Acquiring lock "cinder-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:03:02 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Lock "cinder-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:03:02 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Acquiring lock "cinder-quobyte-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:03:02 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Lock "cinder-quobyte-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada" acquired by "delete_volume" :: waited 0.038s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[01855a14-50ce-4edc-a594-0032f7fc9c2a]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:03 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-518ff4bd-0037-403a-82f5-2cf0c96e16a1 tempest-GroupSnapshotsV319Test-954935653 None] group_snapshot dcc7aefc-df5a-475a-bd06-dcc0a002bd1d: created successfully Sep 03 20:03:03 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada Sep 03 20:03:03 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:03 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada" returned: 0 in 0.409s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:03 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada Sep 03 20:03:03 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:03 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] group_snapshot dcc7aefc-df5a-475a-bd06-dcc0a002bd1d: deleting Sep 03 20:03:03 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada" returned: 0 in 0.347s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Lock "cinder-quobyte-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada" released by "delete_volume" :: held 0.825s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] group_snapshot dcc7aefc-df5a-475a-bd06-dcc0a002bd1d: deleting {{(pid=87582) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Acquiring lock "cinder-quobyte-132356b2-1841-4633-b020-db33a69ee9a0" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Lock "cinder-quobyte-132356b2-1841-4633-b020-db33a69ee9a0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Acquiring lock "cinder-quobyte-83c180e4-e17d-4d02-972c-481cd384cac7" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Lock "cinder-quobyte-83c180e4-e17d-4d02-972c-481cd384cac7" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Deleting offline snapshot 83c180e4-e17d-4d02-972c-481cd384cac7 of volume 132356b2-1841-4633-b020-db33a69ee9a0 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] snapshot_file for this snap is: volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8880340-0c05-4745-8953-ad447356cbfe]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:03 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Created reservations ['407b890d-9dcd-46ac-a14d-284a61345ff4', '75b925ce-881a-4c66-9761-348b36b4acb3', '91f0a3ba-e670-4876-9e63-5718fe85f1df', '6fabb85f-5167-4232-ac02-3bccef1d633e'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:04 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 Sep 03 20:03:04 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:04 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:03:04 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:04 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:04 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7" returned: 0 in 0.501s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-132356b2-1841-4633-b020-db33a69ee9a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.387s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:03:04 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Deleted volume successfully. Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fc368f-40e0-451e-a29b-42a4111e1c9b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dabb2433-ade3-4e4f-bd14-310c26850213 tempest-DeleteServersTestJSON-2101927598 None] Lock "cinder-57b92a0e-c09f-4dc3-834b-ff6ed1bb9ada-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:03:04 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0 Sep 03 20:03:04 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:04 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0" returned: 0 in 0.420s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:04 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 Sep 03 20:03:04 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:05 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7" returned: 0 in 0.415s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:05 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7 Sep 03 20:03:05 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:05 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0.83c180e4-e17d-4d02-972c-481cd384cac7" returned: 0 in 0.264s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Lock "cinder-quobyte-83c180e4-e17d-4d02-972c-481cd384cac7" released by "_delete_snapshot" :: held 1.756s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:03:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Lock "cinder-quobyte-132356b2-1841-4633-b020-db33a69ee9a0" released by "delete_snapshot" :: held 1.809s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:03:05 devstack cinder-volume[87582]: WARNING cinder.quota [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1128970436 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1128970436, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:03:05 devstack cinder-volume[87582]: WARNING cinder.quota [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1128970436 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1128970436, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:03:05 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] Created reservations ['380fabfa-f781-4d42-84f5-46556b085cf1', '5221985f-cc3e-4b3d-99b7-f5770b653c80', 'f3a593cf-4d95-475d-bb17-259e413d3e29', '1227fc20-3ea4-4835-99f8-69abeebc81a6'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:03:05 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8234c0a5-3dc6-44e0-8bcb-d6f93197a616 tempest-GroupSnapshotsV319Test-954935653 None] group_snapshot dcc7aefc-df5a-475a-bd06-dcc0a002bd1d: deleted successfully Sep 03 20:03:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Acquiring lock "cinder-quobyte-132356b2-1841-4633-b020-db33a69ee9a0" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:03:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Lock "cinder-quobyte-132356b2-1841-4633-b020-db33a69ee9a0" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:03:06 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7008a33-c94a-4bca-8b08-0ea714f9fc82]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:03:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:06 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0 Sep 03 20:03:06 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:07 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0" returned: 0 in 0.538s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:07 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0 Sep 03 20:03:07 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:07 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-132356b2-1841-4633-b020-db33a69ee9a0" returned: 0 in 0.322s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Lock "cinder-quobyte-132356b2-1841-4633-b020-db33a69ee9a0" released by "delete_volume" :: held 0.936s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:03:07 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Created reservations ['05ae097b-8c6e-4e47-b573-b72ef716dde4'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:03:07 devstack cinder-volume[87582]: WARNING cinder.quota [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1128970436 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1128970436, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:03:07 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Created reservations ['413e2ac4-616a-4c5e-a88d-2ea7e2a0dc05', '8cc956fe-9834-471c-a10a-5428ef26bda6', '9f73a010-ac93-48a0-8a5c-b6ab4201e1d8', 'd30e1361-8b63-43d8-97a5-cf49495e8896'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:03:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:03:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:03:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:08 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:03:08 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:08 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.334s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:08 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:03:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-96c8dda7-c407-4dff-933e-6cd782014144 tempest-GroupSnapshotsV319Test-954935653 None] Delete group completed successfully. Sep 03 20:03:18 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=35,cinder:INSERT=9,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:03:18 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=43,cinder:UPDATE=37,cinder:INSERT=7 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:03:30 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7c3fb5a2-bb1c-4d59-8d02-2a5d1449d694 tempest-GroupsV314Test-1113734728 None] Group tempest-GroupsV314Test-Group-1961159633: creating Sep 03 20:03:31 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7c3fb5a2-bb1c-4d59-8d02-2a5d1449d694 tempest-GroupsV314Test-1113734728 None] Group tempest-GroupsV314Test-Group-1961159633: created successfully Sep 03 20:03:31 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7c3fb5a2-bb1c-4d59-8d02-2a5d1449d694 tempest-GroupsV314Test-1113734728 None] Create group completed successfully. Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Flow 'volume_create_manager' (82460ae5-4e61-4045-9b0d-2e40449c31bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b34bdda-c0c5-42cf-a867-d74f00c43237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b34bdda-c0c5-42cf-a867-d74f00c43237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899619195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf64d581-51b7-4ff1-9863-11d19a628e55,host='devstack@QuobyteHD#QuobyteHD',id=43c435e1-6f3c-4278-baf2-a4a49345f202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b0c0885bf6495e950445ea09408309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:03:33Z,use_quota=True,user_id='72bbc7fee4b04c2da1688ecd6555b982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa0f2f03-0c1c-4f10-9f01-9867be8265a5),volume_type_id=fa0f2f03-0c1c-4f10-9f01-9867be8265a5)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845a0f3f-caad-459f-839c-e4bdee0d8a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845a0f3f-caad-459f-839c-e4bdee0d8a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a87459-5f8b-4455-9edb-e0d850c9dfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a87459-5f8b-4455-9edb-e0d850c9dfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43c435e1-6f3c-4278-baf2-a4a49345f202', 'volume_name': 'volume-43c435e1-6f3c-4278-baf2-a4a49345f202', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41c5cdc-e744-47df-a24b-e3f7421e2da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41c5cdc-e744-47df-a24b-e3f7421e2da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ed9760-591c-4130-a6b5-2553390e2b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:33 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Volume 43c435e1-6f3c-4278-baf2-a4a49345f202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43c435e1-6f3c-4278-baf2-a4a49345f202', 'volume_size': 1} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cf64d581-51b7-4ff1-9863-11d19a628e55,created_at=2026-09-03T18:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899619195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf64d581-51b7-4ff1-9863-11d19a628e55,host='devstack@QuobyteHD#QuobyteHD',id=43c435e1-6f3c-4278-baf2-a4a49345f202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b0c0885bf6495e950445ea09408309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:03:33Z,use_quota=True,user_id='72bbc7fee4b04c2da1688ecd6555b982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa0f2f03-0c1c-4f10-9f01-9867be8265a5),volume_type_id=fa0f2f03-0c1c-4f10-9f01-9867be8265a5)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Creating volume 43c435e1-6f3c-4278-baf2-a4a49345f202 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:03:33 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:33 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 1073741824 Sep 03 20:03:33 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:33 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 1073741824" returned: 0 in 0.592s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:33 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 Sep 03 20:03:33 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:34 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202" returned: 0 in 0.378s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:03:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ed9760-591c-4130-a6b5-2553390e2b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c435e1-6f3c-4278-baf2-a4a49345f202', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de76ca67-84cc-431d-a394-223ebd6f9056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:34 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Volume volume-43c435e1-6f3c-4278-baf2-a4a49345f202 (43c435e1-6f3c-4278-baf2-a4a49345f202): created successfully Sep 03 20:03:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de76ca67-84cc-431d-a394-223ebd6f9056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Flow 'volume_create_manager' (82460ae5-4e61-4045-9b0d-2e40449c31bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:03:34 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-557f9cba-1447-4441-8fe5-23af20a6cea7 tempest-GroupsV314Test-1113734728 None] Created volume successfully. Sep 03 20:03:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:36 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Cloning volume 43c435e1-6f3c-4278-baf2-a4a49345f202 to volume a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e Sep 03 20:03:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Creating offline snapshot ae9042ed-0286-417a-97da-c11dd6fc182c of volume 43c435e1-6f3c-4278-baf2-a4a49345f202 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:03:36 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0315a9e8-bda2-45cb-be07-e9887a0e8569]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:03:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:03:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:03:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:03:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:36 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:03:36 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:37 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 Sep 03 20:03:37 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:37 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.622s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:03:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:03:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 8 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:03:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:03:37 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202" returned: 0 in 0.900s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:37 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c 1G Sep 03 20:03:37 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:38 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c 1G" returned: 0 in 0.858s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43c435e1-6f3c-4278-baf2-a4a49345f202 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:38 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43c435e1-6f3c-4278-baf2-a4a49345f202 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c Sep 03 20:03:38 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:38 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43c435e1-6f3c-4278-baf2-a4a49345f202 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c" returned: 0 in 0.401s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:38 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:03:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:38 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c Sep 03 20:03:38 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:39 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c" returned: 0 in 0.294s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:39 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.info Sep 03 20:03:39 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:39 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.info" returned: 0 in 0.323s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:39 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:39 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.info Sep 03 20:03:39 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:39 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.info" returned: 0 in 0.357s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Acquiring lock "cinder-quobyte-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e" by "_copy_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Lock "cinder-quobyte-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] snapshot: ae9042ed-0286-417a-97da-c11dd6fc182c, volume: a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e, {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd936fb-0c26-4b66-9ba9-3bd8357e27b3]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:03:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:40 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c Sep 03 20:03:40 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:40 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c" returned: 0 in 0.485s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43c435e1-6f3c-4278-baf2-a4a49345f202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:03:40 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c22b905-0305-4aa0-a027-6a5ec41e90e9]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:03:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:40 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 Sep 03 20:03:40 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:40 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202" returned: 0 in 0.504s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 20:03:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Creating direct copy from snapshot {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 20:03:41 devstack cinder-volume[87582]: DEBUG cinder.utils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Path /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e not found in is_blk_device check {{(pid=87582) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 20:03:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:41 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e Sep 03 20:03:41 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:44 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:03:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Flow 'volume_create_manager' (4127651c-6dfc-4526-8d80-cdf84d663eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:03:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7f6663-a1b4-4d1a-96eb-eeb691440a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7f6663-a1b4-4d1a-96eb-eeb691440a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-878023231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff33c39d-396d-4011-b887-1efef4efa39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800e67bf380f4c51b0edb1a84e695c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:03:44Z,use_quota=True,user_id='4af4ca0fa9674dada36bc7ed8797743d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfcbac7-b4a1-4510-a66a-74511ebabf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfcbac7-b4a1-4510-a66a-74511ebabf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e65aa1-1824-4ba5-9f8e-7c93ff52386e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e65aa1-1824-4ba5-9f8e-7c93ff52386e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff33c39d-396d-4011-b887-1efef4efa39a', 'volume_name': 'volume-ff33c39d-396d-4011-b887-1efef4efa39a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934d3c51-ee90-4b75-9c2f-4dcb506f74f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934d3c51-ee90-4b75-9c2f-4dcb506f74f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660abd69-541f-4e89-8de6-5c068281b719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:44 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Volume ff33c39d-396d-4011-b887-1efef4efa39a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff33c39d-396d-4011-b887-1efef4efa39a', 'volume_size': 1} Sep 03 20:03:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:47 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e" returned: 0 in 6.042s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:47 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:03:47 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Converted 1024.00 MB image at 169.46 MB/s Sep 03 20:03:47 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:03:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:47 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e Sep 03 20:03:47 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:47 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e" returned: 0 in 0.336s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Lock "cinder-quobyte-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e" released by "_copy_volume_from_snapshot" :: held 7.474s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:03:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Acquiring lock "cinder-quobyte-ae9042ed-0286-417a-97da-c11dd6fc182c" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:03:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Lock "cinder-quobyte-ae9042ed-0286-417a-97da-c11dd6fc182c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:03:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Deleting offline snapshot ae9042ed-0286-417a-97da-c11dd6fc182c of volume 43c435e1-6f3c-4278-baf2-a4a49345f202 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:03:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] snapshot_file for this snap is: volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:03:47 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[de48a869-be1e-49a9-9272-25dce42dc782]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:03:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:47 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c Sep 03 20:03:47 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:48 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c" returned: 0 in 0.647s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43c435e1-6f3c-4278-baf2-a4a49345f202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:03:48 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d34772-fdec-4e60-bd3c-13a024280b27]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:03:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:48 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 Sep 03 20:03:48 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:49 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202" returned: 0 in 0.881s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:49 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c Sep 03 20:03:49 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:49 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c" returned: 0 in 0.518s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:49 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c Sep 03 20:03:49 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:49 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202.ae9042ed-0286-417a-97da-c11dd6fc182c" returned: 0 in 0.273s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Lock "cinder-quobyte-ae9042ed-0286-417a-97da-c11dd6fc182c" released by "_delete_snapshot" :: held 2.454s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.349s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.821s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-878023231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff33c39d-396d-4011-b887-1efef4efa39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800e67bf380f4c51b0edb1a84e695c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:03:44Z,use_quota=True,user_id='4af4ca0fa9674dada36bc7ed8797743d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Creating volume ff33c39d-396d-4011-b887-1efef4efa39a {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:03:49 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:03:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff33c39d-396d-4011-b887-1efef4efa39a 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:49 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff33c39d-396d-4011-b887-1efef4efa39a 1073741824 Sep 03 20:03:49 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-446335c7-0d62-4d7a-bf96-8f9056031ec7 tempest-GroupsV314Test-1113734728 None] Create group from source-group-cf64d581-51b7-4ff1-9863-11d19a628e55 completed successfully. Sep 03 20:03:50 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff33c39d-396d-4011-b887-1efef4efa39a 1073741824" returned: 0 in 0.459s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff33c39d-396d-4011-b887-1efef4efa39a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:50 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff33c39d-396d-4011-b887-1efef4efa39a Sep 03 20:03:50 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:50 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff33c39d-396d-4011-b887-1efef4efa39a" returned: 0 in 0.260s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:03:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660abd69-541f-4e89-8de6-5c068281b719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff33c39d-396d-4011-b887-1efef4efa39a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a54596-68d3-4483-8f2e-ae08e9fced32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:50 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Volume volume-ff33c39d-396d-4011-b887-1efef4efa39a (ff33c39d-396d-4011-b887-1efef4efa39a): created successfully Sep 03 20:03:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a54596-68d3-4483-8f2e-ae08e9fced32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Flow 'volume_create_manager' (4127651c-6dfc-4526-8d80-cdf84d663eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:03:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-79d05b0c-dfe5-47f3-85fa-cbba6eeb4f7b tempest-AttachVolumeNegativeTest-1786179125 None] Created volume successfully. Sep 03 20:03:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Acquiring lock "cinder-quobyte-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:03:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Lock "cinder-quobyte-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:03:51 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a7f508-078f-4f3d-9519-162746eeee6c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:03:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:51 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e Sep 03 20:03:51 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:51 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e" returned: 0 in 0.492s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:51 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e Sep 03 20:03:51 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:52 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e" returned: 0 in 0.341s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Lock "cinder-quobyte-a2eec2b5-fb1b-456f-86dd-e03d3b37ac3e" released by "delete_volume" :: held 0.921s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Created reservations ['46b9e763-393a-4915-9474-0a0a9df31c68'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:03:52 devstack cinder-volume[87582]: WARNING cinder.quota [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1842175221 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1842175221, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:03:52 devstack cinder-volume[87582]: WARNING cinder.quota [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1842175221 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1842175221, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Created reservations ['ba6a2c17-f1ad-44ca-8e8d-59d8eb7cd2cd', 'd9eab397-6416-4ca8-9cf2-7ba2e89f494e', '578da774-cc2e-453c-abd2-779a7b5a6b64', 'b50e28b1-4fb2-4083-8eaf-53639438f0bf'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:52 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:03:52 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-3b61df65-efca-4b63-8cb8-77dbaf3cdd81 req-62652ac5-ebed-4503-a502-4819dede9e45 tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-3b61df65-efca-4b63-8cb8-77dbaf3cdd81 req-62652ac5-ebed-4503-a502-4819dede9e45 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-3b61df65-efca-4b63-8cb8-77dbaf3cdd81 req-62652ac5-ebed-4503-a502-4819dede9e45 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3b61df65-efca-4b63-8cb8-77dbaf3cdd81 req-62652ac5-ebed-4503-a502-4819dede9e45 tempest-AttachVolumeNegativeTest-1786179125 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-ff33c39d-396d-4011-b887-1efef4efa39a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb471b99-a5fd-4772-af64-49ffc4e6b2a6', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:03:52 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.387s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Acquiring lock "cinder-quobyte-43c435e1-6f3c-4278-baf2-a4a49345f202" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:03:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-61855028-ade3-423a-8c46-91c2bb36fc04 tempest-GroupsV314Test-1113734728 None] Delete group completed successfully. Sep 03 20:03:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-3b61df65-efca-4b63-8cb8-77dbaf3cdd81 req-62652ac5-ebed-4503-a502-4819dede9e45 tempest-AttachVolumeNegativeTest-1786179125 None] attachment_update completed successfully. Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Lock "cinder-quobyte-43c435e1-6f3c-4278-baf2-a4a49345f202" acquired by "delete_volume" :: waited 0.031s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c9af4f-c86b-4676-aa69-df5980aeac7c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:03:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:53 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 Sep 03 20:03:53 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:53 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202" returned: 0 in 0.512s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:53 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202 Sep 03 20:03:53 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:53 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-43c435e1-6f3c-4278-baf2-a4a49345f202" returned: 0 in 0.324s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Lock "cinder-quobyte-43c435e1-6f3c-4278-baf2-a4a49345f202" released by "delete_volume" :: held 0.930s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:03:53 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Created reservations ['14296b15-246d-485a-be89-04d62a66b694'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:03:53 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Created reservations ['10479c58-0950-4694-99ae-ec648f57f000', '17e295e1-c5fd-4cc1-9a86-dc0ba54902e7', '740b22a7-7465-4f5a-a755-10fe880bfd85', '20cd9f84-b548-4b54-9e0b-2bbc00aeb7f3'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:03:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:03:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:03:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:54 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:03:54 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:54 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.299s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:54 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:03:54 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-1109d8f1-6815-41a9-97d9-720537034954 tempest-GroupsV314Test-1113734728 None] Delete group completed successfully. Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Flow 'volume_create_manager' (eb51b659-154c-4e2f-8fb4-f72384060870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1cef5f-57e2-4fdd-a6ed-11e33ebdf4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1cef5f-57e2-4fdd-a6ed-11e33ebdf4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-3265107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a5281e-f382-42c3-b476-e3c648b9fc57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1d2b7814cd43bdb42dbd73c7013fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:03:55Z,use_quota=True,user_id='8f8a588b5fc24498a76e91dbdbd80099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fcf5ac-57f8-4f86-aa42-a11e95af41d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fcf5ac-57f8-4f86-aa42-a11e95af41d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21da09e7-76ce-41b4-b9ce-90ad400f7f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21da09e7-76ce-41b4-b9ce-90ad400f7f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a5281e-f382-42c3-b476-e3c648b9fc57', 'volume_name': 'volume-b4a5281e-f382-42c3-b476-e3c648b9fc57', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7851ad84-fc5e-48f8-a9e1-198c4ba0020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7851ad84-fc5e-48f8-a9e1-198c4ba0020a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0140861-ad88-4a52-af0e-5e865ebcfebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:55 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Volume b4a5281e-f382-42c3-b476-e3c648b9fc57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a5281e-f382-42c3-b476-e3c648b9fc57', 'volume_size': 1} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-3265107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a5281e-f382-42c3-b476-e3c648b9fc57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1d2b7814cd43bdb42dbd73c7013fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:03:55Z,use_quota=True,user_id='8f8a588b5fc24498a76e91dbdbd80099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Creating volume b4a5281e-f382-42c3-b476-e3c648b9fc57 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:03:55 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b4a5281e-f382-42c3-b476-e3c648b9fc57 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:55 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b4a5281e-f382-42c3-b476-e3c648b9fc57 1073741824 Sep 03 20:03:55 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:55 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b4a5281e-f382-42c3-b476-e3c648b9fc57 1073741824" returned: 0 in 0.624s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Flow 'volume_create_manager' (88d88cf3-32a9-4844-b8ff-efc63e0de5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51418db3-5ccf-48b5-8f00-7f6493d9b51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b4a5281e-f382-42c3-b476-e3c648b9fc57 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51418db3-5ccf-48b5-8f00-7f6493d9b51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1035372025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5a4859-627b-4686-8f28-edda6baa8328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='848cdd3b584049e794cabf10b71914a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:03:56Z,use_quota=True,user_id='1b85d23759684667a7946ff169f4d53f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d345f6f-c49c-47d6-8b4b-a743ba9efc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:56 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b4a5281e-f382-42c3-b476-e3c648b9fc57 Sep 03 20:03:56 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d345f6f-c49c-47d6-8b4b-a743ba9efc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc455c64-b404-4d77-a4e2-ec5a61dfd55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc455c64-b404-4d77-a4e2-ec5a61dfd55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc5a4859-627b-4686-8f28-edda6baa8328', 'volume_name': 'volume-bc5a4859-627b-4686-8f28-edda6baa8328', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a9b537-1023-463b-af26-f756ccdf9261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a9b537-1023-463b-af26-f756ccdf9261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9a6765-39cd-4939-9c5c-97b1f31c312c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:56 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Volume bc5a4859-627b-4686-8f28-edda6baa8328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc5a4859-627b-4686-8f28-edda6baa8328', 'volume_size': 1} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:56 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b4a5281e-f382-42c3-b476-e3c648b9fc57" returned: 0 in 0.323s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.262s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1035372025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5a4859-627b-4686-8f28-edda6baa8328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='848cdd3b584049e794cabf10b71914a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:03:56Z,use_quota=True,user_id='1b85d23759684667a7946ff169f4d53f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Creating volume bc5a4859-627b-4686-8f28-edda6baa8328 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:03:56 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc5a4859-627b-4686-8f28-edda6baa8328 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0140861-ad88-4a52-af0e-5e865ebcfebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a5281e-f382-42c3-b476-e3c648b9fc57', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9025bb3-1172-49ee-8e4c-207f7c019185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:56 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc5a4859-627b-4686-8f28-edda6baa8328 1073741824 Sep 03 20:03:56 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:56 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Volume volume-b4a5281e-f382-42c3-b476-e3c648b9fc57 (b4a5281e-f382-42c3-b476-e3c648b9fc57): created successfully Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9025bb3-1172-49ee-8e4c-207f7c019185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Flow 'volume_create_manager' (eb51b659-154c-4e2f-8fb4-f72384060870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:03:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-be603bfc-c441-470a-b8fe-3979a5fed229 tempest-AttachVolumeShelveTestJSON-891522323 None] Created volume successfully. Sep 03 20:03:56 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc5a4859-627b-4686-8f28-edda6baa8328 1073741824" returned: 0 in 0.544s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc5a4859-627b-4686-8f28-edda6baa8328 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:03:56 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc5a4859-627b-4686-8f28-edda6baa8328 Sep 03 20:03:56 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:03:57 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Sep 03 20:03:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc5a4859-627b-4686-8f28-edda6baa8328" returned: 0 in 0.314s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:03:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:03:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:03:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9a6765-39cd-4939-9c5c-97b1f31c312c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc5a4859-627b-4686-8f28-edda6baa8328', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bd55bb-fd86-4591-8683-79c0374b7a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:03:57 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Volume volume-bc5a4859-627b-4686-8f28-edda6baa8328 (bc5a4859-627b-4686-8f28-edda6baa8328): created successfully Sep 03 20:03:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bd55bb-fd86-4591-8683-79c0374b7a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:03:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Flow 'volume_create_manager' (88d88cf3-32a9-4844-b8ff-efc63e0de5a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:03:57 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-830a4714-ac55-405f-a5ad-c81de0298401 tempest-TaggedAttachmentsTest-993170828 None] Created volume successfully. Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Flow 'volume_create_manager' (5dce0567-9515-47b8-b42e-9dd2e556314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c67dffc-ee94-4b64-a811-6906f67d6d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c67dffc-ee94-4b64-a811-6906f67d6d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1708909419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ddea2029f246d6bc61dd9c0ece3531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:04:02Z,use_quota=True,user_id='66c7fe520bfb4294ac4da576bb2d2e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4540cde-d6fe-43a6-ad2c-b174308891cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4540cde-d6fe-43a6-ad2c-b174308891cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a14f29-95de-438e-8505-bc8540ed0687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a14f29-95de-438e-8505-bc8540ed0687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a', 'volume_name': 'volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4032b18-0fd4-40c5-88a1-2c19110381be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4032b18-0fd4-40c5-88a1-2c19110381be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838b4bfa-deb6-4167-8332-129a19265869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:04:01 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Volume fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a', 'volume_size': 1} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1708909419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ddea2029f246d6bc61dd9c0ece3531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:04:02Z,use_quota=True,user_id='66c7fe520bfb4294ac4da576bb2d2e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Creating volume fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:04:01 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:04:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:01 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a 1073741824 Sep 03 20:04:01 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:02 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a 1073741824" returned: 0 in 0.581s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:02 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a Sep 03 20:04:02 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:02 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" returned: 0 in 0.360s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:04:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:04:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838b4bfa-deb6-4167-8332-129a19265869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:04:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc41d1bd-47ff-48a3-9165-e1e613755c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:04:02 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Volume volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a (fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a): created successfully Sep 03 20:04:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc41d1bd-47ff-48a3-9165-e1e613755c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:04:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Flow 'volume_create_manager' (5dce0567-9515-47b8-b42e-9dd2e556314f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:04:02 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d0b91a4c-be4d-48d7-955d-d9ab021d3952 tempest-SnapshotsActionsTest-1948347851 None] Created volume successfully. Sep 03 20:04:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:04:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:04:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] Creating offline snapshot e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 of volume fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:04:04 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ba26c5-4035-47bf-b0d2-be200a4e4b45]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:04 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a Sep 03 20:04:04 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:04 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" returned: 0 in 0.492s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:04 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 1G Sep 03 20:04:04 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:05 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 1G" returned: 0 in 0.887s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:05 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 Sep 03 20:04:05 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:06 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" returned: 0 in 0.511s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:06 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 is being set with open permissions: ugo+rw Sep 03 20:04:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:06 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 Sep 03 20:04:06 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:06 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" returned: 0 in 0.527s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:06 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.info Sep 03 20:04:06 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:07 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.info" returned: 0 in 0.540s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:07 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.info is being set with open permissions: ugo+rw Sep 03 20:04:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:07 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.info Sep 03 20:04:07 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:07 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.info" returned: 0 in 0.460s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.580s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:04:07 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-bfcac2dc-4f6b-4499-9c51-d4690d222b27 tempest-SnapshotsActionsTest-1948347851 None] Create snapshot completed successfully Sep 03 20:04:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:04:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:04:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] Creating offline snapshot dc258458-ea98-45c0-b1d4-81b30e266ecd of volume fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:04:09 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1be1153-a9b6-4178-bf52-c245a0ad9510]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:09 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 Sep 03 20:04:09 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:10 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" returned: 0 in 0.601s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:04:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:10 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd 1G Sep 03 20:04:10 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:11 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd 1G" returned: 0 in 1.015s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:11 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd Sep 03 20:04:11 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:12 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd" returned: 0 in 0.802s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:12 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd is being set with open permissions: ugo+rw Sep 03 20:04:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:12 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd Sep 03 20:04:12 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:12 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd" returned: 0 in 0.693s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.361s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:04:12 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5d33fe67-0a2a-447e-b550-857523970a17 tempest-SnapshotsActionsTest-1948347851 None] Create snapshot completed successfully Sep 03 20:04:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-2b3a78c5-998c-4ceb-b781-cbfc218c36fa req-2f85421a-225a-4fb6-9b8b-1512858ac13a tempest-AttachVolumeShelveTestJSON-891522323 None] No connector for attachment 0dce69c8-c47e-40dc-83b3-b466a59d7dc6; skipping storage backend terminate_connection call. {{(pid=87582) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 03 20:04:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-2b3a78c5-998c-4ceb-b781-cbfc218c36fa req-2f85421a-225a-4fb6-9b8b-1512858ac13a tempest-AttachVolumeShelveTestJSON-891522323 None] Deleting attachment 0dce69c8-c47e-40dc-83b3-b466a59d7dc6. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:04:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Acquiring lock "cinder-dc258458-ea98-45c0-b1d4-81b30e266ecd-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-dc258458-ea98-45c0-b1d4-81b30e266ecd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Acquiring lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Acquiring lock "cinder-quobyte-dc258458-ea98-45c0-b1d4-81b30e266ecd" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-dc258458-ea98-45c0-b1d4-81b30e266ecd" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Deleting offline snapshot dc258458-ea98-45c0-b1d4-81b30e266ecd of volume fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:04:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] snapshot_file for this snap is: volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:04:14 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bafb89-595a-4fa8-890d-4be84dd7c0e2]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:14 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd Sep 03 20:04:14 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:15 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd" returned: 0 in 0.556s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:04:15 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4181c1-00a1-4bac-8e7d-27ce4bea4626]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:15 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 Sep 03 20:04:15 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:16 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" returned: 0 in 0.780s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:04:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:16 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd Sep 03 20:04:16 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:16 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd" returned: 0 in 0.867s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:17 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd Sep 03 20:04:17 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:17 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.dc258458-ea98-45c0-b1d4-81b30e266ecd" returned: 0 in 0.895s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-dc258458-ea98-45c0-b1d4-81b30e266ecd" released by "_delete_snapshot" :: held 3.285s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" released by "delete_snapshot" :: held 3.357s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:18 devstack cinder-volume[87582]: WARNING cinder.quota [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:04:18 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Created reservations ['88732f83-cc42-4e29-81b1-a8c1529cbc10', 'bca44644-86c3-452b-a2f8-397747e60e5c', '3a040f08-ed7d-4a82-a7fc-a48fc2f54f92', '8f4286ac-1662-4fe4-a97c-ce0bfdc83fb6'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:04:18 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Delete snapshot completed successfully. Sep 03 20:04:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-24196c7b-75db-4cd1-848a-e1ae26d7a688 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-dc258458-ea98-45c0-b1d4-81b30e266ecd-delete_snapshot" released by "delete_snapshot" :: held 3.679s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:04:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:04:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] Creating offline snapshot af83d59b-51c3-4dac-90b8-be5fa3cff912 of volume fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:04:20 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db7fb6a-daa0-4922-8855-bf9858b6c52d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:20 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 Sep 03 20:04:20 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:20 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" returned: 0 in 0.542s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:04:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:20 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 1G Sep 03 20:04:20 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:21 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 1G" returned: 0 in 0.684s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:21 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 Sep 03 20:04:21 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:21 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912" returned: 0 in 0.408s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:21 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 is being set with open permissions: ugo+rw Sep 03 20:04:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:21 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 Sep 03 20:04:21 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:22 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912" returned: 0 in 0.387s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:04:22 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-34526b7c-3cf6-4371-b89c-b9ef63be8e40 tempest-SnapshotsActionsTest-1948347851 None] Create snapshot completed successfully Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Acquiring lock "cinder-af83d59b-51c3-4dac-90b8-be5fa3cff912-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-af83d59b-51c3-4dac-90b8-be5fa3cff912-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Acquiring lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Acquiring lock "cinder-quobyte-af83d59b-51c3-4dac-90b8-be5fa3cff912" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-af83d59b-51c3-4dac-90b8-be5fa3cff912" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Deleting offline snapshot af83d59b-51c3-4dac-90b8-be5fa3cff912 of volume fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] snapshot_file for this snap is: volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4371b01b-60f7-496b-a553-f25088719bac]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:23 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 Sep 03 20:04:23 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:23 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912" returned: 0 in 0.420s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4109063b-48c1-4766-aed0-d5947ea327e8]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:23 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 Sep 03 20:04:23 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:24 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" returned: 0 in 0.441s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:04:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:24 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 Sep 03 20:04:24 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:24 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912" returned: 0 in 0.439s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:24 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912 Sep 03 20:04:24 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:24 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.af83d59b-51c3-4dac-90b8-be5fa3cff912" returned: 0 in 0.252s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-af83d59b-51c3-4dac-90b8-be5fa3cff912" released by "_delete_snapshot" :: held 1.696s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" released by "delete_snapshot" :: held 1.741s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:25 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Created reservations ['ef98e907-4259-4337-963c-20f5ee5b6a85', 'd43f7626-5118-4e10-9ea4-f91e6367cc24', '20f1adea-4cff-4cc1-b9f2-b9edf2445f81', '9ed07f02-e0ec-43ed-a056-1104b423ebd9'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:04:25 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Delete snapshot completed successfully. Sep 03 20:04:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-565ca640-f45b-4e64-ad2e-bedbaa93900a tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-af83d59b-51c3-4dac-90b8-be5fa3cff912-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:04:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:04:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] Creating offline snapshot f4817748-c2f8-40e9-9e89-b450826e790b of volume fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:04:25 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0327795-89ef-4555-86f3-5ac3d25fc5f0]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:25 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 Sep 03 20:04:25 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:26 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" returned: 0 in 0.434s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:04:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:26 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b 1G Sep 03 20:04:26 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:26 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b 1G" returned: 0 in 0.578s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:26 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b Sep 03 20:04:26 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:27 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b" returned: 0 in 0.611s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:27 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b is being set with open permissions: ugo+rw Sep 03 20:04:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:27 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b Sep 03 20:04:27 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:27 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b" returned: 0 in 0.391s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:04:28 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ba697339-9a30-444f-8699-6187347ed72a tempest-SnapshotsActionsTest-1948347851 None] Create snapshot completed successfully Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Acquiring lock "cinder-f4817748-c2f8-40e9-9e89-b450826e790b-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-f4817748-c2f8-40e9-9e89-b450826e790b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Acquiring lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Acquiring lock "cinder-quobyte-f4817748-c2f8-40e9-9e89-b450826e790b" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-f4817748-c2f8-40e9-9e89-b450826e790b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Deleting offline snapshot f4817748-c2f8-40e9-9e89-b450826e790b of volume fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] snapshot_file for this snap is: volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[886de9e1-a231-4751-b00b-ca275f743661]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:29 devstack sudo[91506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b Sep 03 20:04:29 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:29 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b" returned: 0 in 0.549s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[229f5d6c-a810-4687-94a3-390a79212491]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:30 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 Sep 03 20:04:30 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:30 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" returned: 0 in 0.402s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:04:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:30 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b Sep 03 20:04:30 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:30 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b" returned: 0 in 0.423s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:30 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b Sep 03 20:04:30 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:31 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.f4817748-c2f8-40e9-9e89-b450826e790b" returned: 0 in 0.279s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-f4817748-c2f8-40e9-9e89-b450826e790b" released by "_delete_snapshot" :: held 1.809s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" released by "delete_snapshot" :: held 1.860s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:31 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=68,cinder:UPDATE=63,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:04:31 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:UPDATE=54,cinder:SELECT=60,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:04:31 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Created reservations ['87b09ebd-e736-4b3e-ab39-2257de99995a', 'c0f0fad4-a113-4bae-9083-18a640080ef2', '4c2e1253-1d60-4469-b271-cc0f414f25bb', '76b4d977-773b-424b-a247-000575652e17'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:04:31 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Delete snapshot completed successfully. Sep 03 20:04:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6af255b6-f4f1-4f05-baf7-51a19ee6ea51 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-f4817748-c2f8-40e9-9e89-b450826e790b-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:04:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:04:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] Creating offline snapshot b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 of volume fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:04:31 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ba84ed-8b08-42c9-bb0c-de03e382b279]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:31 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 Sep 03 20:04:31 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:32 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" returned: 0 in 0.399s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:04:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:32 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 1G Sep 03 20:04:32 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:32 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 1G" returned: 0 in 0.415s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:32 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 Sep 03 20:04:32 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:32 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28" returned: 0 in 0.319s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:32 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 is being set with open permissions: ugo+rw Sep 03 20:04:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:32 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 Sep 03 20:04:32 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:33 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28" returned: 0 in 0.318s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.576s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:04:33 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-3591e86c-a0d0-4f99-a02d-0afe6d8110fc tempest-SnapshotsActionsTest-1948347851 None] Create snapshot completed successfully Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Acquiring lock "cinder-b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Acquiring lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Acquiring lock "cinder-quobyte-b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Deleting offline snapshot b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 of volume fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] snapshot_file for this snap is: volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c4b19a-e4fe-4c0c-b308-bbe10cff4054]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:34 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 Sep 03 20:04:34 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:34 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28" returned: 0 in 0.512s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34b2ae0-316f-45ed-85dc-040480c08f50]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:35 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 Sep 03 20:04:35 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:35 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" returned: 0 in 0.504s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:04:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:35 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 Sep 03 20:04:35 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:35 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28" returned: 0 in 0.513s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:35 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28 Sep 03 20:04:35 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:36 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28" returned: 0 in 0.309s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:36 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28" released by "_delete_snapshot" :: held 2.016s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:36 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" released by "delete_snapshot" :: held 2.062s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:36 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Created reservations ['a6626266-26a2-4036-8a26-224b224d6f4d', 'd5b16d96-55e4-4c84-aee1-a4e80be01ac3', 'c8f0ee81-9eb7-43e1-9db6-dac5f5994677', '27867a93-5456-4b25-941a-5135b285ba0b'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:04:36 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Delete snapshot completed successfully. Sep 03 20:04:36 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-93e0e9ee-cfd4-4b75-a66f-8002e276fb38 tempest-SnapshotsActionsTest-1151893256 None] Lock "cinder-b8b9e9b4-ba94-4cd4-a40a-9bc3c7c4fd28-delete_snapshot" released by "delete_snapshot" :: held 2.305s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:04:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:04:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:04:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:04:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:04:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:04:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:36 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:04:36 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:37 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.288s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:04:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:04:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 8 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:04:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:04:37 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Acquiring lock "cinder-e75256b4-dcb6-4ab4-ac25-f53c454ea0e3-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:37 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Lock "cinder-e75256b4-dcb6-4ab4-ac25-f53c454ea0e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:37 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Acquiring lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:38 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:38 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Acquiring lock "cinder-quobyte-e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:38 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Lock "cinder-quobyte-e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Deleting offline snapshot e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 of volume fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:04:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] snapshot_file for this snap is: volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:04:38 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[70935b53-f368-446a-87b3-78d66425a45c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:38 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 Sep 03 20:04:38 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:38 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" returned: 0 in 0.463s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:04:38 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[89861dce-ece3-4509-ad4f-67ed18e95ea8]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:38 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a Sep 03 20:04:38 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:39 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" returned: 0 in 0.580s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:39 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 Sep 03 20:04:39 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:39 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" returned: 0 in 0.474s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:39 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3 Sep 03 20:04:39 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:39 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-697c9981-74d1-4cde-8a17-199f7fac322a req-08e11178-6c3d-44a3-a3ed-d4eaf79b9b05 tempest-AttachVolumeNegativeTest-1786179125 None] Terminate volume connection completed successfully. Sep 03 20:04:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-697c9981-74d1-4cde-8a17-199f7fac322a req-08e11178-6c3d-44a3-a3ed-d4eaf79b9b05 tempest-AttachVolumeNegativeTest-1786179125 None] Deleting attachment cb471b99-a5fd-4772-af64-49ffc4e6b2a6. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:04:40 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a.e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" returned: 0 in 0.457s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Lock "cinder-quobyte-e75256b4-dcb6-4ab4-ac25-f53c454ea0e3" released by "_delete_snapshot" :: held 2.137s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" released by "delete_snapshot" :: held 2.172s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:40 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Created reservations ['3799845f-e655-48e3-898f-5f2de51fc977', 'e9c77975-1f5b-4aa1-be2b-6feb2af7dcca', 'b7a04af7-e340-4188-ab81-70a297ecd990', '73f10019-06bf-4590-aa9c-5d18eaba9041'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:04:40 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Delete snapshot completed successfully. Sep 03 20:04:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5e27841e-641a-493d-9794-1a6228dd80a1 tempest-SnapshotsActionsTest-1948347851 None] Lock "cinder-e75256b4-dcb6-4ab4-ac25-f53c454ea0e3-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:41 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Acquiring lock "cinder-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:41 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Lock "cinder-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:41 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Acquiring lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:41 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" acquired by "delete_volume" :: waited 0.031s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:41 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe86e4d-62bb-4aa4-b5d5-4d319b2912da]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:41 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a Sep 03 20:04:41 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:42 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" returned: 0 in 0.483s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:42 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a Sep 03 20:04:42 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:42 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" returned: 0 in 0.320s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Lock "cinder-quobyte-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a" released by "delete_volume" :: held 1.093s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:42 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Created reservations ['ed3bdbb6-3903-409b-bcbd-08bb10d95429', 'bb8af23a-aa93-458e-9a21-bb2c2ff6cdbc', '4f5fb441-2672-462e-81d5-d814683527aa', 'b3637887-c344-4abb-8c48-5bd81cc1bb50'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:04:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:04:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:04:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:04:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:04:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:04:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:42 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:04:42 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:43 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.303s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:43 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:04:43 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Deleted volume successfully. Sep 03 20:04:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6843f1b6-3b92-4632-9ec7-8c0266842f97 tempest-SnapshotsActionsTest-1948347851 None] Lock "cinder-fb2ca3c4-ebcc-46b0-b749-3ba2376dab2a-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-2e48ff95-c4d3-44e3-8cbc-6c4f89a92e0f req-b935e615-01c8-4682-aed6-ffa5bf04199f tempest-TaggedAttachmentsTest-993170828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:04:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-2e48ff95-c4d3-44e3-8cbc-6c4f89a92e0f req-b935e615-01c8-4682-aed6-ffa5bf04199f tempest-TaggedAttachmentsTest-993170828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:04:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-2e48ff95-c4d3-44e3-8cbc-6c4f89a92e0f req-b935e615-01c8-4682-aed6-ffa5bf04199f tempest-TaggedAttachmentsTest-993170828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:04:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-2e48ff95-c4d3-44e3-8cbc-6c4f89a92e0f req-b935e615-01c8-4682-aed6-ffa5bf04199f tempest-TaggedAttachmentsTest-993170828 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-bc5a4859-627b-4686-8f28-edda6baa8328', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13ee832c-d72a-4130-970e-bf7d40566024', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:04:45 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-2e48ff95-c4d3-44e3-8cbc-6c4f89a92e0f req-b935e615-01c8-4682-aed6-ffa5bf04199f tempest-TaggedAttachmentsTest-993170828 None] attachment_update completed successfully. Sep 03 20:04:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-738a4d50-3f71-4123-b984-286ba028b697 req-f0bcc225-1225-478d-ae87-026d63214808 tempest-TaggedAttachmentsTest-993170828 None] Terminate volume connection completed successfully. Sep 03 20:04:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-738a4d50-3f71-4123-b984-286ba028b697 req-f0bcc225-1225-478d-ae87-026d63214808 tempest-TaggedAttachmentsTest-993170828 None] Deleting attachment 13ee832c-d72a-4130-970e-bf7d40566024. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:04:55 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=26,cinder:INSERT=9,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:04:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Acquiring lock "cinder-b4a5281e-f382-42c3-b476-e3c648b9fc57-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Lock "cinder-b4a5281e-f382-42c3-b476-e3c648b9fc57-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Acquiring lock "cinder-quobyte-b4a5281e-f382-42c3-b476-e3c648b9fc57" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:04:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Lock "cinder-quobyte-b4a5281e-f382-42c3-b476-e3c648b9fc57" acquired by "delete_volume" :: waited 0.031s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:04:56 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4bc898-2dda-4cdc-9e3d-1ddcc8962df8]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:04:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b4a5281e-f382-42c3-b476-e3c648b9fc57 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:57 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b4a5281e-f382-42c3-b476-e3c648b9fc57 Sep 03 20:04:57 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:57 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b4a5281e-f382-42c3-b476-e3c648b9fc57" returned: 0 in 0.783s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b4a5281e-f382-42c3-b476-e3c648b9fc57 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:57 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b4a5281e-f382-42c3-b476-e3c648b9fc57 Sep 03 20:04:57 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:58 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b4a5281e-f382-42c3-b476-e3c648b9fc57" returned: 0 in 0.331s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Lock "cinder-quobyte-b4a5281e-f382-42c3-b476-e3c648b9fc57" released by "delete_volume" :: held 1.189s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:58 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Created reservations ['e0969cb1-ed89-44bc-b138-510976558731', '3a95d34d-f297-470a-b019-f854fd785330', '5f125c5f-9d50-4199-a92d-bcc3b4d207c4', 'c6923244-cf55-4987-b70b-48d78d7f6d24'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:04:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:04:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:04:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:04:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:04:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:04:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:58 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:04:58 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:04:58 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Sep 03 20:04:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.310s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:04:58 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:04:58 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Deleted volume successfully. Sep 03 20:04:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ca8b3fe6-270e-43f6-8e54-f4b9f2a097d6 tempest-AttachVolumeShelveTestJSON-891522323 None] Lock "cinder-b4a5281e-f382-42c3-b476-e3c648b9fc57-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Flow 'volume_create_manager' (2507c910-de17-4082-8c7b-a71f2aab4a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dbd77e-b9fc-4c26-b36c-a99eb414bf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dbd77e-b9fc-4c26-b36c-a99eb414bf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-136524710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34e5ed5-b160-4a01-a030-43a86ca7e5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc3fe09ea7945428831189db0cf8e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:04:59Z,use_quota=True,user_id='997fd1e04dd64ee4ad7292bc9fce2c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac88e1a4-898a-4c01-87fa-95dde2fd2878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac88e1a4-898a-4c01-87fa-95dde2fd2878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1e5f90-420e-45c1-8df5-d1815c30635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1e5f90-420e-45c1-8df5-d1815c30635a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34e5ed5-b160-4a01-a030-43a86ca7e5d1', 'volume_name': 'volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ed2508-136a-43be-b17b-29c3f4809d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ed2508-136a-43be-b17b-29c3f4809d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaedc21-af1e-413d-ab80-dd847fc8c3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:04:59 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Volume f34e5ed5-b160-4a01-a030-43a86ca7e5d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1', 'volume_size': 1} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-136524710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34e5ed5-b160-4a01-a030-43a86ca7e5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc3fe09ea7945428831189db0cf8e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:04:59Z,use_quota=True,user_id='997fd1e04dd64ee4ad7292bc9fce2c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Creating volume f34e5ed5-b160-4a01-a030-43a86ca7e5d1 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:04:59 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:04:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:04:59 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1 1073741824 Sep 03 20:04:59 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:00 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1 1073741824" returned: 0 in 0.923s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:00 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1 Sep 03 20:05:00 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:01 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1" returned: 0 in 0.368s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:05:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:05:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaedc21-af1e-413d-ab80-dd847fc8c3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3e8c6f-bf62-4e42-b7b1-4eacc99716a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:05:01 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Volume volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1 (f34e5ed5-b160-4a01-a030-43a86ca7e5d1): created successfully Sep 03 20:05:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3e8c6f-bf62-4e42-b7b1-4eacc99716a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Flow 'volume_create_manager' (2507c910-de17-4082-8c7b-a71f2aab4a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:05:01 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5ba4539c-e5b7-4aba-a254-b19381f29af5 tempest-VolumesServicesTestJSON-612773551 None] Created volume successfully. Sep 03 20:05:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Acquiring lock "cinder-f34e5ed5-b160-4a01-a030-43a86ca7e5d1-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:05:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Lock "cinder-f34e5ed5-b160-4a01-a030-43a86ca7e5d1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:05:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Acquiring lock "cinder-quobyte-f34e5ed5-b160-4a01-a030-43a86ca7e5d1" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:05:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Lock "cinder-quobyte-f34e5ed5-b160-4a01-a030-43a86ca7e5d1" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:05:01 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ecd2e2-d392-4aa1-b849-edda36f627dc]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:05:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:01 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1 Sep 03 20:05:01 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:02 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1" returned: 0 in 0.562s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:02 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1 Sep 03 20:05:02 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:02 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f34e5ed5-b160-4a01-a030-43a86ca7e5d1" returned: 0 in 0.438s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:02 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Lock "cinder-quobyte-f34e5ed5-b160-4a01-a030-43a86ca7e5d1" released by "delete_volume" :: held 1.059s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:05:02 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Created reservations ['3b313283-05c8-47b1-a2d4-8e8789335c53', '6717be93-c0dd-44af-a155-7ed774ab3873', 'c87875d0-06b0-405d-8a9e-a18d1d2f94de', 'f3a2b452-082b-4130-b409-743f1f46b556'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:05:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:05:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:05:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:05:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:05:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:05:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:03 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:05:03 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:03 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.417s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:03 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:05:03 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Deleted volume successfully. Sep 03 20:05:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-61b27f4b-bc27-4865-a24a-cfb9604b7a15 tempest-VolumesServicesTestJSON-612773551 None] Lock "cinder-f34e5ed5-b160-4a01-a030-43a86ca7e5d1-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:05:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Acquiring lock "cinder-bc5a4859-627b-4686-8f28-edda6baa8328-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:05:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Lock "cinder-bc5a4859-627b-4686-8f28-edda6baa8328-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:05:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Acquiring lock "cinder-quobyte-bc5a4859-627b-4686-8f28-edda6baa8328" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:05:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Lock "cinder-quobyte-bc5a4859-627b-4686-8f28-edda6baa8328" acquired by "delete_volume" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:05:03 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec6c93b-0ef8-4569-9758-fafcd4e1af39]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:05:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc5a4859-627b-4686-8f28-edda6baa8328 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:03 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc5a4859-627b-4686-8f28-edda6baa8328 Sep 03 20:05:03 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:04 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc5a4859-627b-4686-8f28-edda6baa8328" returned: 0 in 0.417s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc5a4859-627b-4686-8f28-edda6baa8328 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:04 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc5a4859-627b-4686-8f28-edda6baa8328 Sep 03 20:05:04 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:04 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc5a4859-627b-4686-8f28-edda6baa8328" returned: 0 in 0.534s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Lock "cinder-quobyte-bc5a4859-627b-4686-8f28-edda6baa8328" released by "delete_volume" :: held 1.020s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:05:04 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Created reservations ['8d8075be-f178-4bb0-a002-df5a73cc1064', '2dec7d77-9d1c-4128-b584-a7adb22c9c48', 'e6261ccd-c550-4307-b3ce-24c39c7dada0', '3f57edf2-4c98-4c4e-9ff2-c16c174c012d'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:05:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:05:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:05:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:05:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:05:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:05:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:04 devstack sudo[92401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:05:04 devstack sudo[92401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:05 devstack sudo[92401]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.332s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:05 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:05:05 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Deleted volume successfully. Sep 03 20:05:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-903480f5-107e-4fbf-93f0-d2b7dad45731 tempest-TaggedAttachmentsTest-993170828 None] Lock "cinder-bc5a4859-627b-4686-8f28-edda6baa8328-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Flow 'volume_create_manager' (455cf550-cc96-4c70-8967-184c9dfc4f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646dd51f-1b8f-4ba7-9fdd-ecdc75d15b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646dd51f-1b8f-4ba7-9fdd-ecdc75d15b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-18003061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb23f1ab-42b5-4e1f-870f-5b0678f5289f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655d90103ffd46cfa1b6819794f07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:05:14Z,use_quota=True,user_id='f22d690dd9da4714844b79fef2dd28b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b26a044e-5f32-4f33-ab0c-86bedf47d5ef),volume_type_id=b26a044e-5f32-4f33-ab0c-86bedf47d5ef)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508684c8-3c6e-4869-8341-d1e812d04ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508684c8-3c6e-4869-8341-d1e812d04ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8ea711-4466-405b-99b5-2a1adaec9af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8ea711-4466-405b-99b5-2a1adaec9af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb23f1ab-42b5-4e1f-870f-5b0678f5289f', 'volume_name': 'volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854bcfdb-170a-4424-aba0-9aa2961cf0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854bcfdb-170a-4424-aba0-9aa2961cf0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b9fffb-a74b-43fa-b244-b4ea049b04c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:05:14 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Volume eb23f1ab-42b5-4e1f-870f-5b0678f5289f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f', 'volume_size': 1} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-18003061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb23f1ab-42b5-4e1f-870f-5b0678f5289f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655d90103ffd46cfa1b6819794f07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:05:14Z,use_quota=True,user_id='f22d690dd9da4714844b79fef2dd28b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b26a044e-5f32-4f33-ab0c-86bedf47d5ef),volume_type_id=b26a044e-5f32-4f33-ab0c-86bedf47d5ef)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Creating volume eb23f1ab-42b5-4e1f-870f-5b0678f5289f {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:05:14 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:14 devstack sudo[92444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f 1073741824 Sep 03 20:05:14 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:14 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=19,cinder:INSERT=8,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:05:15 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f 1073741824" returned: 0 in 0.554s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:15 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f Sep 03 20:05:15 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:15 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f" returned: 0 in 0.299s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:05:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:05:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b9fffb-a74b-43fa-b244-b4ea049b04c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7dc9840-72f0-4eda-8395-dd75509cc296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:05:15 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Volume volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f (eb23f1ab-42b5-4e1f-870f-5b0678f5289f): created successfully Sep 03 20:05:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7dc9840-72f0-4eda-8395-dd75509cc296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Flow 'volume_create_manager' (455cf550-cc96-4c70-8967-184c9dfc4f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:05:15 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a342029f-2f68-4763-99fa-ed86f8a79750 tempest-VolumeTypesAccessTest-705320637 None] Created volume successfully. Sep 03 20:05:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Acquiring lock "cinder-eb23f1ab-42b5-4e1f-870f-5b0678f5289f-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:05:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Lock "cinder-eb23f1ab-42b5-4e1f-870f-5b0678f5289f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:05:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Acquiring lock "cinder-quobyte-eb23f1ab-42b5-4e1f-870f-5b0678f5289f" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:05:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Lock "cinder-quobyte-eb23f1ab-42b5-4e1f-870f-5b0678f5289f" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:05:16 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ab7c3c-1b4d-4c32-a15c-f7367f3a62df]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:05:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:16 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f Sep 03 20:05:16 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:17 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f" returned: 0 in 0.464s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:17 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f Sep 03 20:05:17 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:17 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb23f1ab-42b5-4e1f-870f-5b0678f5289f" returned: 0 in 0.362s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Lock "cinder-quobyte-eb23f1ab-42b5-4e1f-870f-5b0678f5289f" released by "delete_volume" :: held 0.888s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:05:17 devstack cinder-volume[87582]: WARNING cinder.quota [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1596614695 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1596614695, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:05:17 devstack cinder-volume[87582]: WARNING cinder.quota [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1596614695 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1596614695, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:05:17 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Created reservations ['d692739b-cd5d-4381-a2fd-764ce017f407', 'ddba32dd-23ff-4b0e-bfe9-ac225944c538', 'ae4dfbde-d9de-4945-9d8d-2919ab1341c7', 'd29778bf-2d0d-4d0b-b119-e1692f9a1eb4'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:05:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:05:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:05:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:05:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:05:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:05:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:17 devstack sudo[92472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:05:17 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:18 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.336s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:18 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:05:18 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Deleted volume successfully. Sep 03 20:05:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-64c9c152-6b37-4f3f-8eb2-209cb623db74 tempest-VolumeTypesAccessTest-705320637 None] Lock "cinder-eb23f1ab-42b5-4e1f-870f-5b0678f5289f-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Flow 'volume_create_manager' (fee345f0-fcd8-41b6-952d-d1ec59d16986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1589552-de6d-4aca-bfb5-b619b4ebf1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1589552-de6d-4aca-bfb5-b619b4ebf1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-375164355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1e822d-8770-448b-90bf-68a2180e1a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800e67bf380f4c51b0edb1a84e695c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:05:27Z,use_quota=True,user_id='4af4ca0fa9674dada36bc7ed8797743d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065beba5-46b3-4482-873a-7a7ffa9e8551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065beba5-46b3-4482-873a-7a7ffa9e8551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79eab6ea-d99f-429e-a677-0716d637fd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79eab6ea-d99f-429e-a677-0716d637fd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa1e822d-8770-448b-90bf-68a2180e1a1f', 'volume_name': 'volume-fa1e822d-8770-448b-90bf-68a2180e1a1f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80b21f9-cf27-401e-ad5a-041cde645207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80b21f9-cf27-401e-ad5a-041cde645207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84731ffa-4781-4a0e-aaac-9123b8620c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:05:26 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Volume fa1e822d-8770-448b-90bf-68a2180e1a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa1e822d-8770-448b-90bf-68a2180e1a1f', 'volume_size': 1} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-375164355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1e822d-8770-448b-90bf-68a2180e1a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800e67bf380f4c51b0edb1a84e695c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:05:27Z,use_quota=True,user_id='4af4ca0fa9674dada36bc7ed8797743d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Creating volume fa1e822d-8770-448b-90bf-68a2180e1a1f {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:05:26 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:05:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fa1e822d-8770-448b-90bf-68a2180e1a1f 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:26 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fa1e822d-8770-448b-90bf-68a2180e1a1f 1073741824 Sep 03 20:05:26 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:27 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fa1e822d-8770-448b-90bf-68a2180e1a1f 1073741824" returned: 0 in 0.625s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fa1e822d-8770-448b-90bf-68a2180e1a1f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:27 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fa1e822d-8770-448b-90bf-68a2180e1a1f Sep 03 20:05:27 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:28 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fa1e822d-8770-448b-90bf-68a2180e1a1f" returned: 0 in 0.372s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:05:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:05:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84731ffa-4781-4a0e-aaac-9123b8620c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa1e822d-8770-448b-90bf-68a2180e1a1f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cf72e9-c4d4-4e08-99e0-3ff3a35fcc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:05:28 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Volume volume-fa1e822d-8770-448b-90bf-68a2180e1a1f (fa1e822d-8770-448b-90bf-68a2180e1a1f): created successfully Sep 03 20:05:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cf72e9-c4d4-4e08-99e0-3ff3a35fcc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:05:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Flow 'volume_create_manager' (fee345f0-fcd8-41b6-952d-d1ec59d16986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:05:28 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-1e1a3124-56d5-4254-835a-7f9641d1c87b tempest-AttachVolumeNegativeTest-1786179125 None] Created volume successfully. Sep 03 20:05:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-a9a0f8bb-1ed4-4f1e-b2d6-17fc71b84927 req-a7e482af-305a-4143-ade3-886c70b83a9d tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:05:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-a9a0f8bb-1ed4-4f1e-b2d6-17fc71b84927 req-a7e482af-305a-4143-ade3-886c70b83a9d tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:05:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-a9a0f8bb-1ed4-4f1e-b2d6-17fc71b84927 req-a7e482af-305a-4143-ade3-886c70b83a9d tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:05:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-a9a0f8bb-1ed4-4f1e-b2d6-17fc71b84927 req-a7e482af-305a-4143-ade3-886c70b83a9d tempest-AttachVolumeNegativeTest-1786179125 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-fa1e822d-8770-448b-90bf-68a2180e1a1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98dfadda-2da5-46ef-a215-97d3d6eb536e', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:05:30 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-a9a0f8bb-1ed4-4f1e-b2d6-17fc71b84927 req-a7e482af-305a-4143-ade3-886c70b83a9d tempest-AttachVolumeNegativeTest-1786179125 None] attachment_update completed successfully. Sep 03 20:05:33 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-76e634f5-9214-4bd3-81c1-ac52c0c77889 req-d40ce2b9-2e97-4c47-8427-f604f7c69227 tempest-AttachVolumeNegativeTest-1786179125 None] Terminate volume connection completed successfully. Sep 03 20:05:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-76e634f5-9214-4bd3-81c1-ac52c0c77889 req-d40ce2b9-2e97-4c47-8427-f604f7c69227 tempest-AttachVolumeNegativeTest-1786179125 None] Deleting attachment 98dfadda-2da5-46ef-a215-97d3d6eb536e. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:05:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:05:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:05:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:05:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:05:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:05:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:05:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:05:36 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:05:36 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:05:37 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Sep 03 20:05:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.430s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:05:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:05:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:05:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 8 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:05:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:05:40 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:INSERT=16,cinder:UPDATE=70,cinder:SELECT=61,cinder:DELETE=4 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:05:43 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=20,cinder:UPDATE=15,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Flow 'volume_create_manager' (2e607fb4-90e7-4749-9eb8-f2a08fe774a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0dbfdcb-9df0-4e5e-b031-017dec23f710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0dbfdcb-9df0-4e5e-b031-017dec23f710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1525921506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29a2991-3f49-4800-a2ab-3df76e28d386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b1157453464404ab4c63ce241f7b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:07Z,use_quota=True,user_id='37dfe25c9ba042399c53ead252a110c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76d8d6c-e71a-42eb-a51b-e00581fedc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76d8d6c-e71a-42eb-a51b-e00581fedc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cce640a-494e-489d-bcfb-3ad10a038b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cce640a-494e-489d-bcfb-3ad10a038b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29a2991-3f49-4800-a2ab-3df76e28d386', 'volume_name': 'volume-b29a2991-3f49-4800-a2ab-3df76e28d386', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fb145d-20c8-4b7e-aae8-079c00ed41eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fb145d-20c8-4b7e-aae8-079c00ed41eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded73a20-13d9-4db1-9f84-0550304f8fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:07 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Volume b29a2991-3f49-4800-a2ab-3df76e28d386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29a2991-3f49-4800-a2ab-3df76e28d386', 'volume_size': 1} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1525921506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29a2991-3f49-4800-a2ab-3df76e28d386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b1157453464404ab4c63ce241f7b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:07Z,use_quota=True,user_id='37dfe25c9ba042399c53ead252a110c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Creating volume b29a2991-3f49-4800-a2ab-3df76e28d386 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:06:07 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:06:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b29a2991-3f49-4800-a2ab-3df76e28d386 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:07 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b29a2991-3f49-4800-a2ab-3df76e28d386 1073741824 Sep 03 20:06:07 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:08 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b29a2991-3f49-4800-a2ab-3df76e28d386 1073741824" returned: 0 in 0.803s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b29a2991-3f49-4800-a2ab-3df76e28d386 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:08 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b29a2991-3f49-4800-a2ab-3df76e28d386 Sep 03 20:06:08 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:08 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b29a2991-3f49-4800-a2ab-3df76e28d386" returned: 0 in 0.423s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:06:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded73a20-13d9-4db1-9f84-0550304f8fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29a2991-3f49-4800-a2ab-3df76e28d386', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4acbe7-bab9-4a2e-ac6c-9bc1da78e796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:08 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Volume volume-b29a2991-3f49-4800-a2ab-3df76e28d386 (b29a2991-3f49-4800-a2ab-3df76e28d386): created successfully Sep 03 20:06:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4acbe7-bab9-4a2e-ac6c-9bc1da78e796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Flow 'volume_create_manager' (2e607fb4-90e7-4749-9eb8-f2a08fe774a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d50d7ad3-8026-49c8-8779-01d67e890d63 tempest-AttachVolumeTestJSON-136447603 None] Created volume successfully. Sep 03 20:06:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-be0d940b-09a8-4f16-8ee4-622a6c2cf6c2 req-248e6d52-56b5-4e2e-ae97-ca2ea55e42db tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-be0d940b-09a8-4f16-8ee4-622a6c2cf6c2 req-248e6d52-56b5-4e2e-ae97-ca2ea55e42db tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-be0d940b-09a8-4f16-8ee4-622a6c2cf6c2 req-248e6d52-56b5-4e2e-ae97-ca2ea55e42db tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-be0d940b-09a8-4f16-8ee4-622a6c2cf6c2 req-248e6d52-56b5-4e2e-ae97-ca2ea55e42db tempest-AttachVolumeTestJSON-136447603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-b29a2991-3f49-4800-a2ab-3df76e28d386', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5e2ff51-0c5d-4a59-b8b4-07fdd7a0a254', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:06:11 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-be0d940b-09a8-4f16-8ee4-622a6c2cf6c2 req-248e6d52-56b5-4e2e-ae97-ca2ea55e42db tempest-AttachVolumeTestJSON-136447603 None] attachment_update completed successfully. Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Flow 'volume_create_manager' (47e77489-2fb1-4ea7-b48f-de5746526f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d12dc22-aa72-42a5-981b-d95e213b0709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d12dc22-aa72-42a5-981b-d95e213b0709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1213923502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0e7850-823b-4f33-ba5e-1cc41b605fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800e67bf380f4c51b0edb1a84e695c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:27Z,use_quota=True,user_id='4af4ca0fa9674dada36bc7ed8797743d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a560a68-5be6-4375-8937-acee4242e8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a560a68-5be6-4375-8937-acee4242e8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ba9c91-66a2-4242-8cce-9c30f52c323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ba9c91-66a2-4242-8cce-9c30f52c323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f0e7850-823b-4f33-ba5e-1cc41b605fc1', 'volume_name': 'volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7bbe477-8844-4524-a745-e301048d9df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7bbe477-8844-4524-a745-e301048d9df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e826c35-8802-4888-bd54-1889cbd18710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:26 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Volume 3f0e7850-823b-4f33-ba5e-1cc41b605fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1', 'volume_size': 1} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1213923502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0e7850-823b-4f33-ba5e-1cc41b605fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800e67bf380f4c51b0edb1a84e695c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:27Z,use_quota=True,user_id='4af4ca0fa9674dada36bc7ed8797743d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Creating volume 3f0e7850-823b-4f33-ba5e-1cc41b605fc1 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:06:26 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:06:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:26 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1 1073741824 Sep 03 20:06:26 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Flow 'volume_create_manager' (fe624b6d-08df-48b3-ae0f-e6fd6c916362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6c65ad-4e1b-4773-823c-557d046d555a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6c65ad-4e1b-4773-823c-557d046d555a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-120211584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb042c5c-bb83-4988-88e8-23585e58dd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b9dacd9b642e2a98fce2b6bf405a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:27Z,use_quota=True,user_id='75597f125f6e4d9abb8ddf06f1f1f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d14117-531b-47be-9641-f7838b824489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d14117-531b-47be-9641-f7838b824489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885a4cbd-d3f9-4c95-9f69-7d95ffac7586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885a4cbd-d3f9-4c95-9f69-7d95ffac7586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb042c5c-bb83-4988-88e8-23585e58dd1a', 'volume_name': 'volume-eb042c5c-bb83-4988-88e8-23585e58dd1a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03959168-0d45-4e9b-83dd-a574e8615a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03959168-0d45-4e9b-83dd-a574e8615a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d39c87d-cf7f-4fdd-9018-2b016b136aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:27 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Volume eb042c5c-bb83-4988-88e8-23585e58dd1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb042c5c-bb83-4988-88e8-23585e58dd1a', 'volume_size': 1} Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:27 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1 1073741824" returned: 0 in 0.897s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:27 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1 Sep 03 20:06:27 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:28 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1" returned: 0 in 0.281s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.417s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-120211584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb042c5c-bb83-4988-88e8-23585e58dd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b9dacd9b642e2a98fce2b6bf405a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:27Z,use_quota=True,user_id='75597f125f6e4d9abb8ddf06f1f1f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Creating volume eb042c5c-bb83-4988-88e8-23585e58dd1a {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:06:28 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb042c5c-bb83-4988-88e8-23585e58dd1a 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e826c35-8802-4888-bd54-1889cbd18710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488bbab0-60a2-40e7-804b-a7dc239d6fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:28 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb042c5c-bb83-4988-88e8-23585e58dd1a 1073741824 Sep 03 20:06:28 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:28 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Volume volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1 (3f0e7850-823b-4f33-ba5e-1cc41b605fc1): created successfully Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488bbab0-60a2-40e7-804b-a7dc239d6fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Flow 'volume_create_manager' (47e77489-2fb1-4ea7-b48f-de5746526f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:28 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7178883a-c367-4f94-ab4c-f7d6a17eaffb tempest-AttachVolumeNegativeTest-1786179125 None] Created volume successfully. Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Flow 'volume_create_manager' (e9875b5c-dee0-4b38-ae3a-9a86e6e485fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1c317a-06af-4466-b308-f68a9f6bf32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1c317a-06af-4466-b308-f68a9f6bf32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-986495243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72081664-b977-457a-a7c9-12b81f297df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52954898c649ffbbd7e30c8c328017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:29Z,use_quota=True,user_id='102794108773457d926b9c21055e0d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e200fa8f-a8fc-4c8b-9fb5-38c849ee1462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e200fa8f-a8fc-4c8b-9fb5-38c849ee1462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c444da-7da4-4e3c-a467-f1d857aeca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c444da-7da4-4e3c-a467-f1d857aeca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72081664-b977-457a-a7c9-12b81f297df7', 'volume_name': 'volume-72081664-b977-457a-a7c9-12b81f297df7', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d32bae-80dd-4d4c-9304-dd489cc46510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d32bae-80dd-4d4c-9304-dd489cc46510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211bdedc-0810-471b-ae03-82db2c69a45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:29 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Volume 72081664-b977-457a-a7c9-12b81f297df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72081664-b977-457a-a7c9-12b81f297df7', 'volume_size': 1} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:29 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb042c5c-bb83-4988-88e8-23585e58dd1a 1073741824" returned: 0 in 0.953s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb042c5c-bb83-4988-88e8-23585e58dd1a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:29 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb042c5c-bb83-4988-88e8-23585e58dd1a Sep 03 20:06:29 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:29 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb042c5c-bb83-4988-88e8-23585e58dd1a" returned: 0 in 0.466s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.656s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-986495243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72081664-b977-457a-a7c9-12b81f297df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52954898c649ffbbd7e30c8c328017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:29Z,use_quota=True,user_id='102794108773457d926b9c21055e0d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Creating volume 72081664-b977-457a-a7c9-12b81f297df7 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:06:29 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-72081664-b977-457a-a7c9-12b81f297df7 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:29 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-72081664-b977-457a-a7c9-12b81f297df7 1073741824 Sep 03 20:06:29 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d39c87d-cf7f-4fdd-9018-2b016b136aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb042c5c-bb83-4988-88e8-23585e58dd1a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1faf7ce3-8a76-4ab8-becc-146c3f87ba9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:29 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Volume volume-eb042c5c-bb83-4988-88e8-23585e58dd1a (eb042c5c-bb83-4988-88e8-23585e58dd1a): created successfully Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1faf7ce3-8a76-4ab8-becc-146c3f87ba9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Flow 'volume_create_manager' (fe624b6d-08df-48b3-ae0f-e6fd6c916362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:29 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-fe0b6999-f347-443e-8ff4-09d6d65417c2 tempest-VolumesActionsTest-1700182253 None] Created volume successfully. Sep 03 20:06:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-283a828d-c218-4a84-a08b-0e5b81f52ed1 req-9370372f-ad68-4114-9416-b4aa572a304d tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:30 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-72081664-b977-457a-a7c9-12b81f297df7 1073741824" returned: 0 in 0.971s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-72081664-b977-457a-a7c9-12b81f297df7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:30 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-72081664-b977-457a-a7c9-12b81f297df7 Sep 03 20:06:30 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6f0fa913-cc83-49e6-a9e8-3df2ad577175 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "cinder-eb042c5c-bb83-4988-88e8-23585e58dd1a" by "attach_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6f0fa913-cc83-49e6-a9e8-3df2ad577175 tempest-VolumesActionsTest-1700182253 None] Lock "cinder-eb042c5c-bb83-4988-88e8-23585e58dd1a" acquired by "attach_volume" :: waited 0.038s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:31 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6f0fa913-cc83-49e6-a9e8-3df2ad577175 tempest-VolumesActionsTest-1700182253 None] Attaching volume eb042c5c-bb83-4988-88e8-23585e58dd1a to instance ac655ac1-6854-4b4d-bb04-7073ed150183 at mountpoint /dev/vdb on host None. Sep 03 20:06:31 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-72081664-b977-457a-a7c9-12b81f297df7" returned: 0 in 0.412s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:06:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-283a828d-c218-4a84-a08b-0e5b81f52ed1 req-9370372f-ad68-4114-9416-b4aa572a304d tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.494s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:31 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6f0fa913-cc83-49e6-a9e8-3df2ad577175 tempest-VolumesActionsTest-1700182253 None] Attach volume completed successfully. Sep 03 20:06:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211bdedc-0810-471b-ae03-82db2c69a45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72081664-b977-457a-a7c9-12b81f297df7', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436982e2-8076-434d-bab8-ee1aea71241a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6f0fa913-cc83-49e6-a9e8-3df2ad577175 tempest-VolumesActionsTest-1700182253 None] Lock "cinder-eb042c5c-bb83-4988-88e8-23585e58dd1a" released by "attach_volume" :: held 0.325s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:31 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Volume volume-72081664-b977-457a-a7c9-12b81f297df7 (72081664-b977-457a-a7c9-12b81f297df7): created successfully Sep 03 20:06:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436982e2-8076-434d-bab8-ee1aea71241a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Flow 'volume_create_manager' (e9875b5c-dee0-4b38-ae3a-9a86e6e485fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-283a828d-c218-4a84-a08b-0e5b81f52ed1 req-9370372f-ad68-4114-9416-b4aa572a304d tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.189s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:31 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c1a3d8c0-76d9-4b3d-a1a0-6ccc509721e4 tempest-ServerActionsTestOtherA-1138108255 None] Created volume successfully. Sep 03 20:06:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-283a828d-c218-4a84-a08b-0e5b81f52ed1 req-9370372f-ad68-4114-9416-b4aa572a304d tempest-AttachVolumeNegativeTest-1786179125 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec0fff23-820b-4310-9412-456222b0451f', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:06:31 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-283a828d-c218-4a84-a08b-0e5b81f52ed1 req-9370372f-ad68-4114-9416-b4aa572a304d tempest-AttachVolumeNegativeTest-1786179125 None] attachment_update completed successfully. Sep 03 20:06:32 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b15fa42c-5507-468a-a9c3-e81936a15f28 tempest-VolumesActionsTest-587176755 None] Terminate volume connection completed successfully. Sep 03 20:06:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b15fa42c-5507-468a-a9c3-e81936a15f28 tempest-VolumesActionsTest-587176755 None] Acquiring lock "cinder-eb042c5c-bb83-4988-88e8-23585e58dd1a-detach_volume" by "detach_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b15fa42c-5507-468a-a9c3-e81936a15f28 tempest-VolumesActionsTest-587176755 None] Lock "cinder-eb042c5c-bb83-4988-88e8-23585e58dd1a-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:32 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b15fa42c-5507-468a-a9c3-e81936a15f28 tempest-VolumesActionsTest-587176755 None] Detaching volume eb042c5c-bb83-4988-88e8-23585e58dd1a from instance ac655ac1-6854-4b4d-bb04-7073ed150183. Sep 03 20:06:32 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b15fa42c-5507-468a-a9c3-e81936a15f28 tempest-VolumesActionsTest-587176755 None] Detach volume completed successfully. Sep 03 20:06:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b15fa42c-5507-468a-a9c3-e81936a15f28 tempest-VolumesActionsTest-587176755 None] Lock "cinder-eb042c5c-bb83-4988-88e8-23585e58dd1a-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c604336c-ff90-4242-a58d-75c06ab0d4ca tempest-VolumesActionsTest-1700182253 None] Acquiring lock "cinder-eb042c5c-bb83-4988-88e8-23585e58dd1a-detach_volume" by "detach_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c604336c-ff90-4242-a58d-75c06ab0d4ca tempest-VolumesActionsTest-1700182253 None] Lock "cinder-eb042c5c-bb83-4988-88e8-23585e58dd1a-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:32 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c604336c-ff90-4242-a58d-75c06ab0d4ca tempest-VolumesActionsTest-1700182253 None] Volume detach called, but volume not attached. Sep 03 20:06:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c604336c-ff90-4242-a58d-75c06ab0d4ca tempest-VolumesActionsTest-1700182253 None] Lock "cinder-eb042c5c-bb83-4988-88e8-23585e58dd1a-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "cinder-eb042c5c-bb83-4988-88e8-23585e58dd1a-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Lock "cinder-eb042c5c-bb83-4988-88e8-23585e58dd1a-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "cinder-quobyte-eb042c5c-bb83-4988-88e8-23585e58dd1a" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Lock "cinder-quobyte-eb042c5c-bb83-4988-88e8-23585e58dd1a" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:33 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b648dc-3c3b-4e8d-8b4f-4216b485c083]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:06:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb042c5c-bb83-4988-88e8-23585e58dd1a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:33 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb042c5c-bb83-4988-88e8-23585e58dd1a Sep 03 20:06:33 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:34 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-7f727c32-8e9e-436f-bd11-7d44b0cbab9e req-35d544a0-e484-47c7-99fb-c8c91a3e0f3a tempest-AttachVolumeNegativeTest-1786179125 None] Terminate volume connection completed successfully. Sep 03 20:06:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-7f727c32-8e9e-436f-bd11-7d44b0cbab9e req-35d544a0-e484-47c7-99fb-c8c91a3e0f3a tempest-AttachVolumeNegativeTest-1786179125 None] Deleting attachment ec0fff23-820b-4310-9412-456222b0451f. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:06:34 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb042c5c-bb83-4988-88e8-23585e58dd1a" returned: 0 in 0.550s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb042c5c-bb83-4988-88e8-23585e58dd1a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:34 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb042c5c-bb83-4988-88e8-23585e58dd1a Sep 03 20:06:34 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:34 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-eb042c5c-bb83-4988-88e8-23585e58dd1a" returned: 0 in 0.632s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Lock "cinder-quobyte-eb042c5c-bb83-4988-88e8-23585e58dd1a" released by "delete_volume" :: held 1.248s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:34 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Created reservations ['50925aa6-1318-458e-a62f-b44424312da1', 'f269ee64-0fd1-48de-8ce6-597bf295338c', 'ba199e82-4b5b-4207-9036-b36610ddab73', 'fc92b12e-aff3-41c4-b16d-7eb034992a42'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:06:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:35 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:06:35 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:35 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.465s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:35 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:06:35 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Deleted volume successfully. Sep 03 20:06:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-aec6a594-425b-46cc-938c-a56b2626fb54 tempest-VolumesActionsTest-1700182253 None] Lock "cinder-eb042c5c-bb83-4988-88e8-23585e58dd1a-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:06:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:36 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:06:36 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:37 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.466s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:06:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:06:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 8 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:06:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:06:40 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:06:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Flow 'volume_create_manager' (3b2a37d5-8897-4b7f-bfbe-1d1fba6f8cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4d606f-f151-4073-9e1e-ff0accd7f9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4d606f-f151-4073-9e1e-ff0accd7f9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-380464148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3cb3c05-e392-45b5-80b3-052718bad07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b9dacd9b642e2a98fce2b6bf405a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:41Z,use_quota=True,user_id='75597f125f6e4d9abb8ddf06f1f1f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19f7c69-910d-47b0-9213-1771c878e058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19f7c69-910d-47b0-9213-1771c878e058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2c6da5-d8b1-4388-904a-907a201726ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2c6da5-d8b1-4388-904a-907a201726ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3cb3c05-e392-45b5-80b3-052718bad07e', 'volume_name': 'volume-b3cb3c05-e392-45b5-80b3-052718bad07e', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857b08c7-5514-4fb3-a5f5-0bebd0c1e42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857b08c7-5514-4fb3-a5f5-0bebd0c1e42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fef338-6c7b-4827-84b0-dad20d194448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:41 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Volume b3cb3c05-e392-45b5-80b3-052718bad07e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3cb3c05-e392-45b5-80b3-052718bad07e', 'volume_size': 1} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-380464148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3cb3c05-e392-45b5-80b3-052718bad07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b9dacd9b642e2a98fce2b6bf405a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:41Z,use_quota=True,user_id='75597f125f6e4d9abb8ddf06f1f1f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Creating volume b3cb3c05-e392-45b5-80b3-052718bad07e {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:06:41 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3cb3c05-e392-45b5-80b3-052718bad07e 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:41 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3cb3c05-e392-45b5-80b3-052718bad07e 1073741824 Sep 03 20:06:41 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:41 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3cb3c05-e392-45b5-80b3-052718bad07e 1073741824" returned: 0 in 0.804s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3cb3c05-e392-45b5-80b3-052718bad07e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:42 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3cb3c05-e392-45b5-80b3-052718bad07e Sep 03 20:06:42 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "cinder-3f0e7850-823b-4f33-ba5e-1cc41b605fc1-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "cinder-3f0e7850-823b-4f33-ba5e-1cc41b605fc1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "cinder-quobyte-3f0e7850-823b-4f33-ba5e-1cc41b605fc1" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "cinder-quobyte-3f0e7850-823b-4f33-ba5e-1cc41b605fc1" acquired by "delete_volume" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e19237-de47-4e65-9a70-6b5956383fb9]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:42 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3cb3c05-e392-45b5-80b3-052718bad07e" returned: 0 in 0.536s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fef338-6c7b-4827-84b0-dad20d194448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3cb3c05-e392-45b5-80b3-052718bad07e', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775d8a11-fb5f-4f75-b75e-bad6b8589b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:42 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Volume volume-b3cb3c05-e392-45b5-80b3-052718bad07e (b3cb3c05-e392-45b5-80b3-052718bad07e): created successfully Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775d8a11-fb5f-4f75-b75e-bad6b8589b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Flow 'volume_create_manager' (3b2a37d5-8897-4b7f-bfbe-1d1fba6f8cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:42 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1 Sep 03 20:06:42 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:42 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-84a66fba-fd7a-4741-b766-9961a24f5b2e tempest-VolumesActionsTest-1700182253 None] Created volume successfully. Sep 03 20:06:43 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1" returned: 0 in 0.614s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:43 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1 Sep 03 20:06:43 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Acquiring lock "cinder-b3cb3c05-e392-45b5-80b3-052718bad07e-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Lock "cinder-b3cb3c05-e392-45b5-80b3-052718bad07e-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:43 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0e7850-823b-4f33-ba5e-1cc41b605fc1" returned: 0 in 0.538s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "cinder-quobyte-3f0e7850-823b-4f33-ba5e-1cc41b605fc1" released by "delete_volume" :: held 1.249s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Acquiring lock "cinder-quobyte-b3cb3c05-e392-45b5-80b3-052718bad07e" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Lock "cinder-quobyte-b3cb3c05-e392-45b5-80b3-052718bad07e" acquired by "delete_volume" :: waited 0.033s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cab1b1a-3d3d-45f4-9fbc-12248c4bb29e]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3cb3c05-e392-45b5-80b3-052718bad07e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Created reservations ['02b3cce3-16c1-4527-a850-910163850356', 'aa1a48bb-f475-4e68-b400-31e8d36d82a3', '4a419282-f65c-4077-96d1-6c3ba6786db7', '3bd9f116-2202-4547-8b3d-0b5b88591e46'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:44 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3cb3c05-e392-45b5-80b3-052718bad07e Sep 03 20:06:44 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:44 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:06:44 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:44 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.299s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:06:44 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Deleted volume successfully. Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-744998b2-6c91-422b-8f75-9440c5b52375 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "cinder-3f0e7850-823b-4f33-ba5e-1cc41b605fc1-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:44 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3cb3c05-e392-45b5-80b3-052718bad07e" returned: 0 in 0.725s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3cb3c05-e392-45b5-80b3-052718bad07e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:44 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3cb3c05-e392-45b5-80b3-052718bad07e Sep 03 20:06:44 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:44 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3cb3c05-e392-45b5-80b3-052718bad07e" returned: 0 in 0.329s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "cinder-fa1e822d-8770-448b-90bf-68a2180e1a1f-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Lock "cinder-quobyte-b3cb3c05-e392-45b5-80b3-052718bad07e" released by "delete_volume" :: held 1.138s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "cinder-fa1e822d-8770-448b-90bf-68a2180e1a1f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "cinder-quobyte-fa1e822d-8770-448b-90bf-68a2180e1a1f" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Created reservations ['f46cb8b0-b919-48d5-b489-f399d1ee49fa', 'd3b731b6-c091-4fc6-8b66-e8aa48ee93c4', 'c8ba1c25-87fc-4b75-b910-1a75ee758c0f', '7c24eee3-e634-4665-a1a6-70343171e481'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "cinder-quobyte-fa1e822d-8770-448b-90bf-68a2180e1a1f" acquired by "delete_volume" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59a567f-981b-45c6-91d2-296f948b246e]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:06:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fa1e822d-8770-448b-90bf-68a2180e1a1f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:45 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:06:45 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:45 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fa1e822d-8770-448b-90bf-68a2180e1a1f Sep 03 20:06:45 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:45 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.292s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:06:45 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Deleted volume successfully. Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0fb21756-a39c-4091-ab36-35a1a401d3fb tempest-VolumesActionsTest-587176755 None] Lock "cinder-b3cb3c05-e392-45b5-80b3-052718bad07e-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:45 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fa1e822d-8770-448b-90bf-68a2180e1a1f" returned: 0 in 0.485s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fa1e822d-8770-448b-90bf-68a2180e1a1f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:45 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fa1e822d-8770-448b-90bf-68a2180e1a1f Sep 03 20:06:45 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:45 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fa1e822d-8770-448b-90bf-68a2180e1a1f" returned: 0 in 0.290s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "cinder-quobyte-fa1e822d-8770-448b-90bf-68a2180e1a1f" released by "delete_volume" :: held 0.826s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Created reservations ['9c3faa57-1db4-4354-8317-3b1a629356c1', '114c3611-8800-4508-afb3-f01f4e78c2cd', 'bd38c422-2c2f-4880-943c-2f071e0f6e1c', '441c241d-c90c-4457-84ca-f9d7870ff4d3'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:46 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:06:46 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:46 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.474s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:06:46 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Deleted volume successfully. Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-34640572-df07-4528-8616-54a889fa7236 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "cinder-fa1e822d-8770-448b-90bf-68a2180e1a1f-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "cinder-ff33c39d-396d-4011-b887-1efef4efa39a-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "cinder-ff33c39d-396d-4011-b887-1efef4efa39a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "cinder-quobyte-ff33c39d-396d-4011-b887-1efef4efa39a" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "cinder-quobyte-ff33c39d-396d-4011-b887-1efef4efa39a" acquired by "delete_volume" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d94a3e7-8390-43a5-b989-b600441999ce]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff33c39d-396d-4011-b887-1efef4efa39a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Flow 'volume_create_manager' (399f95d3-654a-4791-88c2-a49d2f4a0a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ee0290-9af8-40d4-a348-54e744d1d976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ee0290-9af8-40d4-a348-54e744d1d976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-39967248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c0fe42-fdcf-4fd2-b145-8f0e09672878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b9dacd9b642e2a98fce2b6bf405a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:47Z,use_quota=True,user_id='75597f125f6e4d9abb8ddf06f1f1f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31baeece-7359-4e6f-b874-f0d7ce279f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31baeece-7359-4e6f-b874-f0d7ce279f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1caf6635-9d05-4d20-9f46-d209489657c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1caf6635-9d05-4d20-9f46-d209489657c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c0fe42-fdcf-4fd2-b145-8f0e09672878', 'volume_name': 'volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343c824e-b99c-484c-be93-c978bda043ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343c824e-b99c-484c-be93-c978bda043ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6895cd-8da5-439a-9eab-9d33f0fc4cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:46 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Volume 46c0fe42-fdcf-4fd2-b145-8f0e09672878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878', 'volume_size': 1} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-39967248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c0fe42-fdcf-4fd2-b145-8f0e09672878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b9dacd9b642e2a98fce2b6bf405a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:47Z,use_quota=True,user_id='75597f125f6e4d9abb8ddf06f1f1f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Creating volume 46c0fe42-fdcf-4fd2-b145-8f0e09672878 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:06:46 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:06:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:46 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff33c39d-396d-4011-b887-1efef4efa39a Sep 03 20:06:46 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:46 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878 1073741824 Sep 03 20:06:46 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:47 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff33c39d-396d-4011-b887-1efef4efa39a" returned: 0 in 0.493s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff33c39d-396d-4011-b887-1efef4efa39a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:47 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff33c39d-396d-4011-b887-1efef4efa39a Sep 03 20:06:47 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:47 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878 1073741824" returned: 0 in 0.510s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:47 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878 Sep 03 20:06:47 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:47 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff33c39d-396d-4011-b887-1efef4efa39a" returned: 0 in 0.325s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "cinder-quobyte-ff33c39d-396d-4011-b887-1efef4efa39a" released by "delete_volume" :: held 0.912s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Created reservations ['1453b128-5768-4c06-a5ab-a856d80a125c', '37eff6fe-3194-4276-b45f-6d858734a4f5', '121bab49-388f-4533-8893-22b5adb51dc4', '5d955d0c-cb58-465c-836f-0289f076e10a'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:06:47 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878" returned: 0 in 0.323s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6895cd-8da5-439a-9eab-9d33f0fc4cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8176c9bb-f8d5-4266-8432-92d91b8cf316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:47 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Volume volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878 (46c0fe42-fdcf-4fd2-b145-8f0e09672878): created successfully Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8176c9bb-f8d5-4266-8432-92d91b8cf316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:47 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:06:47 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Flow 'volume_create_manager' (399f95d3-654a-4791-88c2-a49d2f4a0a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8b0382c2-b129-4e11-84f7-c0baed4542b1 tempest-VolumesActionsTest-1700182253 None] Created volume successfully. Sep 03 20:06:48 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.299s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:48 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:06:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Deleted volume successfully. Sep 03 20:06:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-186c7356-7c26-426a-8f1b-c31afaf9fd50 tempest-AttachVolumeNegativeTest-1786179125 None] Lock "cinder-ff33c39d-396d-4011-b887-1efef4efa39a-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Acquiring lock "cinder-46c0fe42-fdcf-4fd2-b145-8f0e09672878-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Lock "cinder-46c0fe42-fdcf-4fd2-b145-8f0e09672878-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Acquiring lock "cinder-quobyte-46c0fe42-fdcf-4fd2-b145-8f0e09672878" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Lock "cinder-quobyte-46c0fe42-fdcf-4fd2-b145-8f0e09672878" acquired by "delete_volume" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[289eaf15-96f3-4f42-9188-f6daa87cc272]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:49 devstack sudo[94681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878 Sep 03 20:06:49 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:49 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878" returned: 0 in 0.403s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:49 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878 Sep 03 20:06:49 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:49 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-46c0fe42-fdcf-4fd2-b145-8f0e09672878" returned: 0 in 0.307s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Lock "cinder-quobyte-46c0fe42-fdcf-4fd2-b145-8f0e09672878" released by "delete_volume" :: held 0.765s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Created reservations ['6ded50da-d067-485f-8d7e-08cb8411abcd', '2edc160c-4d89-4955-92c7-a4021b88ece6', '19e207cc-f40f-4766-8458-eac32d3dd210', 'f54f777d-5cf3-4efb-a9d1-16df5721499d'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:50 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:06:50 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:50 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.425s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:06:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Deleted volume successfully. Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a4429fd6-5dca-4bee-b95c-46a7d5935ddb tempest-VolumesActionsTest-587176755 None] Lock "cinder-46c0fe42-fdcf-4fd2-b145-8f0e09672878-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Flow 'volume_create_manager' (33d3c212-977c-4ec8-bd50-62aabc7221ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddd944e-87bf-436b-a8c2-0cbe5a8cbb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddd944e-87bf-436b-a8c2-0cbe5a8cbb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1408857505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1279dc4d-bd6c-4d1b-9e78-50c841e20701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b9dacd9b642e2a98fce2b6bf405a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:51Z,use_quota=True,user_id='75597f125f6e4d9abb8ddf06f1f1f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74149cf-f83d-4517-ae7c-b420d5ef7236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74149cf-f83d-4517-ae7c-b420d5ef7236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461e7531-5e5e-4fd2-aaa6-409c3b06e5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461e7531-5e5e-4fd2-aaa6-409c3b06e5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1279dc4d-bd6c-4d1b-9e78-50c841e20701', 'volume_name': 'volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7484c3-10dc-4bc6-81aa-24b7a77d7166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7484c3-10dc-4bc6-81aa-24b7a77d7166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805c8d90-34ee-4d69-a07a-e6dd30fbdfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:50 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Volume 1279dc4d-bd6c-4d1b-9e78-50c841e20701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701', 'volume_size': 1} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1408857505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1279dc4d-bd6c-4d1b-9e78-50c841e20701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b9dacd9b642e2a98fce2b6bf405a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:51Z,use_quota=True,user_id='75597f125f6e4d9abb8ddf06f1f1f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Creating volume 1279dc4d-bd6c-4d1b-9e78-50c841e20701 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:06:51 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:51 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701 1073741824 Sep 03 20:06:51 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:51 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701 1073741824" returned: 0 in 0.482s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:51 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701 Sep 03 20:06:51 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:51 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701" returned: 0 in 0.286s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805c8d90-34ee-4d69-a07a-e6dd30fbdfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67763f4c-6929-4dba-a013-aad179b81ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:51 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Volume volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701 (1279dc4d-bd6c-4d1b-9e78-50c841e20701): created successfully Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67763f4c-6929-4dba-a013-aad179b81ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Flow 'volume_create_manager' (33d3c212-977c-4ec8-bd50-62aabc7221ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:51 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f9c35690-83a7-4b6d-a60b-eca1ebf9c297 tempest-VolumesActionsTest-1700182253 None] Created volume successfully. Sep 03 20:06:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Acquiring lock "cinder-1279dc4d-bd6c-4d1b-9e78-50c841e20701-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Lock "cinder-1279dc4d-bd6c-4d1b-9e78-50c841e20701-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Acquiring lock "cinder-quobyte-1279dc4d-bd6c-4d1b-9e78-50c841e20701" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Lock "cinder-quobyte-1279dc4d-bd6c-4d1b-9e78-50c841e20701" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:53 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adfaf3f-3810-4d3b-b3fd-cc174bf9357f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:06:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:53 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701 Sep 03 20:06:53 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:53 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701" returned: 0 in 0.430s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:53 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701 Sep 03 20:06:53 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:54 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1279dc4d-bd6c-4d1b-9e78-50c841e20701" returned: 0 in 0.342s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Lock "cinder-quobyte-1279dc4d-bd6c-4d1b-9e78-50c841e20701" released by "delete_volume" :: held 0.825s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:54 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Created reservations ['2a532277-628c-499c-aae3-6342e95e391e', '8f31757e-38a4-49be-8eed-60f645966427', '9694013e-0e77-403e-8ac4-db199cf9ef7b', '183d9aa1-e774-4e83-b4b9-b7881bad5cf6'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:06:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:54 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:06:54 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:54 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.340s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:54 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:06:54 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Deleted volume successfully. Sep 03 20:06:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-de063ab3-4955-47ea-81dc-416a710bfb78 tempest-VolumesActionsTest-587176755 None] Lock "cinder-1279dc4d-bd6c-4d1b-9e78-50c841e20701-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Flow 'volume_create_manager' (124be48f-0098-42af-b552-d6524c96f97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f347f391-9c8f-42a0-9452-4e2cedef35aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f347f391-9c8f-42a0-9452-4e2cedef35aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-68110167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c02be4-68ad-4850-a565-f32256e7e52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b9dacd9b642e2a98fce2b6bf405a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:55Z,use_quota=True,user_id='75597f125f6e4d9abb8ddf06f1f1f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5620d667-a131-4688-a7a3-9e81ac66e482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5620d667-a131-4688-a7a3-9e81ac66e482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8742f0a0-f41e-4660-859e-f72fd49e5026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8742f0a0-f41e-4660-859e-f72fd49e5026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c02be4-68ad-4850-a565-f32256e7e52f', 'volume_name': 'volume-12c02be4-68ad-4850-a565-f32256e7e52f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325fcc7b-f0b3-47aa-af10-48e4c8336c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325fcc7b-f0b3-47aa-af10-48e4c8336c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3540a348-2679-4056-b633-e0b29dbebf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:55 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Volume 12c02be4-68ad-4850-a565-f32256e7e52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c02be4-68ad-4850-a565-f32256e7e52f', 'volume_size': 1} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-68110167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c02be4-68ad-4850-a565-f32256e7e52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b9dacd9b642e2a98fce2b6bf405a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:55Z,use_quota=True,user_id='75597f125f6e4d9abb8ddf06f1f1f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Creating volume 12c02be4-68ad-4850-a565-f32256e7e52f {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:06:55 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12c02be4-68ad-4850-a565-f32256e7e52f 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:55 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12c02be4-68ad-4850-a565-f32256e7e52f 1073741824 Sep 03 20:06:55 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:55 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12c02be4-68ad-4850-a565-f32256e7e52f 1073741824" returned: 0 in 0.593s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12c02be4-68ad-4850-a565-f32256e7e52f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:55 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12c02be4-68ad-4850-a565-f32256e7e52f Sep 03 20:06:55 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:56 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12c02be4-68ad-4850-a565-f32256e7e52f" returned: 0 in 0.325s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:06:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3540a348-2679-4056-b633-e0b29dbebf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c02be4-68ad-4850-a565-f32256e7e52f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f60370f-be97-4ff5-94b2-a2ecb68484c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:56 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Volume volume-12c02be4-68ad-4850-a565-f32256e7e52f (12c02be4-68ad-4850-a565-f32256e7e52f): created successfully Sep 03 20:06:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f60370f-be97-4ff5-94b2-a2ecb68484c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Flow 'volume_create_manager' (124be48f-0098-42af-b552-d6524c96f97f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b5c43505-8f1d-49b2-bd13-0a5683b33947 tempest-VolumesActionsTest-1700182253 None] Created volume successfully. Sep 03 20:06:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Acquiring lock "cinder-12c02be4-68ad-4850-a565-f32256e7e52f-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Lock "cinder-12c02be4-68ad-4850-a565-f32256e7e52f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Acquiring lock "cinder-quobyte-12c02be4-68ad-4850-a565-f32256e7e52f" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:06:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Lock "cinder-quobyte-12c02be4-68ad-4850-a565-f32256e7e52f" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:06:57 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b7c86e-ac94-4ec2-b4bd-1ab2e75e1350]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:06:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12c02be4-68ad-4850-a565-f32256e7e52f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:57 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12c02be4-68ad-4850-a565-f32256e7e52f Sep 03 20:06:57 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:57 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12c02be4-68ad-4850-a565-f32256e7e52f" returned: 0 in 0.402s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12c02be4-68ad-4850-a565-f32256e7e52f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:57 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12c02be4-68ad-4850-a565-f32256e7e52f Sep 03 20:06:57 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:57 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Flow 'volume_create_manager' (0aca30f3-007a-452f-aa57-71d716dea2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31dc8fa7-3da6-4832-809e-5d3c48c31ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31dc8fa7-3da6-4832-809e-5d3c48c31ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2068344728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c737c7-7cd3-40a2-9222-70264da9de62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7d1752b9b24f9ba0b5f8ca8aa4d1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:58Z,use_quota=True,user_id='9f24c224bb904e93b89434966f0b9747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a95dcf-b715-425b-b36e-d384ada74803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a95dcf-b715-425b-b36e-d384ada74803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678bf329-0854-4073-81c3-5e671ad079cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678bf329-0854-4073-81c3-5e671ad079cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c737c7-7cd3-40a2-9222-70264da9de62', 'volume_name': 'volume-74c737c7-7cd3-40a2-9222-70264da9de62', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88fb6cd-3c3a-47f5-96a3-a7650945a166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88fb6cd-3c3a-47f5-96a3-a7650945a166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb563f26-56a6-48b5-a833-191b804e3b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:58 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Volume 74c737c7-7cd3-40a2-9222-70264da9de62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c737c7-7cd3-40a2-9222-70264da9de62', 'volume_size': 1} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2068344728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c737c7-7cd3-40a2-9222-70264da9de62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7d1752b9b24f9ba0b5f8ca8aa4d1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:58Z,use_quota=True,user_id='9f24c224bb904e93b89434966f0b9747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Creating volume 74c737c7-7cd3-40a2-9222-70264da9de62 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:06:58 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:58 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62 1073741824 Sep 03 20:06:58 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:58 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12c02be4-68ad-4850-a565-f32256e7e52f" returned: 0 in 0.276s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Lock "cinder-quobyte-12c02be4-68ad-4850-a565-f32256e7e52f" released by "delete_volume" :: held 0.728s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Created reservations ['906a0eaa-58e0-4469-97db-c1ece1707aa4', 'b8984df4-3e82-47b9-8638-fda6b611f914', 'f5cbf9e5-ae4a-492d-9787-496e16e5a351', '5d0f12d7-7814-4932-b283-b27d4ec36d7c'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:58 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:06:58 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:58 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.360s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:06:58 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Deleted volume successfully. Sep 03 20:06:58 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62 1073741824" returned: 0 in 0.582s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2a901a37-a190-42c1-bbe3-b1482f4bd041 tempest-VolumesActionsTest-587176755 None] Lock "cinder-12c02be4-68ad-4850-a565-f32256e7e52f-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:58 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62 Sep 03 20:06:58 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:58 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-5999ba46-9829-4e94-94e4-54a846fe713a req-ba160a2a-81fd-4c0a-b389-a832eb8320cb tempest-AttachVolumeTestJSON-136447603 None] Terminate volume connection completed successfully. Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-5999ba46-9829-4e94-94e4-54a846fe713a req-ba160a2a-81fd-4c0a-b389-a832eb8320cb tempest-AttachVolumeTestJSON-136447603 None] Deleting attachment d5e2ff51-0c5d-4a59-b8b4-07fdd7a0a254. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:06:58 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62" returned: 0 in 0.281s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:06:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb563f26-56a6-48b5-a833-191b804e3b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c737c7-7cd3-40a2-9222-70264da9de62', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9e5fa8-e941-4a97-86b3-3719a9dacc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:59 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Volume volume-74c737c7-7cd3-40a2-9222-70264da9de62 (74c737c7-7cd3-40a2-9222-70264da9de62): created successfully Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9e5fa8-e941-4a97-86b3-3719a9dacc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Flow 'volume_create_manager' (0aca30f3-007a-452f-aa57-71d716dea2e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:59 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-38411606-82c1-42e5-ae15-bd8db8a2a6fa req-f445046a-4178-4ecc-958b-9b41d21b68db tempest-VolumesSnapshotsTestJSON-308918127 None] Created volume successfully. Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Flow 'volume_create_manager' (5f399915-af2a-46bd-aab2-e13112a98db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c201196a-ec29-4c3d-add7-f68ddecd2745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c201196a-ec29-4c3d-add7-f68ddecd2745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-434200007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b9dacd9b642e2a98fce2b6bf405a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:59Z,use_quota=True,user_id='75597f125f6e4d9abb8ddf06f1f1f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d51efeb-62a5-451a-8154-fda932af93ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d51efeb-62a5-451a-8154-fda932af93ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1231e7b1-6ea1-4cbf-9d17-3cbe5986977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1231e7b1-6ea1-4cbf-9d17-3cbe5986977f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c', 'volume_name': 'volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3595aa9-cf9a-4b61-a7f7-d96df2d32085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3595aa9-cf9a-4b61-a7f7-d96df2d32085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ce97c3-0a90-4128-810d-339ed24b8811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:06:59 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Volume d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c', 'volume_size': 1} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-434200007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b9dacd9b642e2a98fce2b6bf405a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:06:59Z,use_quota=True,user_id='75597f125f6e4d9abb8ddf06f1f1f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Creating volume d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:06:59 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:59 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c 1073741824 Sep 03 20:06:59 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:06:59 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c 1073741824" returned: 0 in 0.403s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:06:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:06:59 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c Sep 03 20:06:59 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:00 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c" returned: 0 in 0.253s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ce97c3-0a90-4128-810d-339ed24b8811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6180597f-30b4-45c0-8032-38e7ebdfc4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:00 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Volume volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c (d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c): created successfully Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6180597f-30b4-45c0-8032-38e7ebdfc4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Flow 'volume_create_manager' (5f399915-af2a-46bd-aab2-e13112a98db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:00 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9045c412-3ee4-41c2-9175-c5748714141f tempest-VolumesActionsTest-1700182253 None] Created volume successfully. Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:UPDATE=102,cinder:SELECT=81,cinder:INSERT=23,cinder:DELETE=3 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] Creating offline snapshot dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c of volume 74c737c7-7cd3-40a2-9222-70264da9de62 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1608aae1-7d67-4061-a73a-49afba898b89]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:00 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62 Sep 03 20:07:00 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:00 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62" returned: 0 in 0.402s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:00 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c 1G Sep 03 20:07:00 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "cinder-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Lock "cinder-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "cinder-quobyte-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Lock "cinder-quobyte-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:01 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4542b2-e5a5-43ed-8424-ac7efc88472e]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:01 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c Sep 03 20:07:01 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:01 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c 1G" returned: 0 in 0.471s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c737c7-7cd3-40a2-9222-70264da9de62 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:01 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c737c7-7cd3-40a2-9222-70264da9de62 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c Sep 03 20:07:01 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:01 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c" returned: 0 in 0.473s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:01 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c Sep 03 20:07:01 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:01 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c737c7-7cd3-40a2-9222-70264da9de62 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c" returned: 0 in 0.374s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:01 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c is being set with open permissions: ugo+rw Sep 03 20:07:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:01 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c Sep 03 20:07:01 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:01 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c" returned: 0 in 0.335s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Lock "cinder-quobyte-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c" released by "delete_volume" :: held 0.863s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:01 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Created reservations ['a4172eb8-1500-492a-b30c-1b241e6b5a9b', '448bd72f-e649-47f1-bb49-e250ec6cc873', '8ec6da1a-427c-4f89-a494-aee43e63f461', 'bba3aaf5-f782-4d81-a47a-e1d01e6b28f8'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:07:02 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c" returned: 0 in 0.266s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:02 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:02 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:02 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.info Sep 03 20:07:02 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:02 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.333s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:07:02 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Deleted volume successfully. Sep 03 20:07:02 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1fe6e51f-72f1-4f13-b732-72aa27aec731 tempest-VolumesActionsTest-1700182253 None] Lock "cinder-d0d0ce74-1c63-4aab-b5b5-e2b6b7a3cd8c-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.info" returned: 0 in 0.340s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:02 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.info is being set with open permissions: ugo+rw Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:02 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.info Sep 03 20:07:02 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:02 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.info" returned: 0 in 0.432s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:02 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-b6a9877d-467a-46e7-8d89-a589b99227a8 req-00c2678d-9660-4f0d-8f2e-0def145ccae4 tempest-VolumesSnapshotsTestJSON-308918127 None] Create snapshot completed successfully Sep 03 20:07:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Acquiring lock "cinder-dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "cinder-dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Acquiring lock "cinder-quobyte-74c737c7-7cd3-40a2-9222-70264da9de62" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "cinder-quobyte-74c737c7-7cd3-40a2-9222-70264da9de62" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Acquiring lock "cinder-quobyte-dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "cinder-quobyte-dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Deleting offline snapshot dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c of volume 74c737c7-7cd3-40a2-9222-70264da9de62 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:07:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] snapshot_file for this snap is: volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:07:04 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b00cbac-60ef-4dd7-b11e-65e43a9b2b5d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:04 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c Sep 03 20:07:04 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:05 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c" returned: 0 in 0.691s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74c737c7-7cd3-40a2-9222-70264da9de62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:07:05 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[11918499-4f52-4be8-8c28-288c3253b602]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:05 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62 Sep 03 20:07:05 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:05 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62" returned: 0 in 0.664s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:05 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c Sep 03 20:07:05 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:06 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c" returned: 0 in 0.574s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:06 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c Sep 03 20:07:06 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:06 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62.dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c" returned: 0 in 0.435s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:06 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=98,cinder:UPDATE=111,cinder:DELETE=15,cinder:INSERT=24 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:07:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "cinder-quobyte-dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c" released by "_delete_snapshot" :: held 2.591s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "cinder-quobyte-74c737c7-7cd3-40a2-9222-70264da9de62" released by "delete_snapshot" :: held 2.640s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:06 devstack cinder-volume[87582]: DEBUG cinder.quota [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Created reservations ['849cc386-9166-442b-8c22-911e28027dfe', '3a671573-2571-4949-8317-26eef8f932bb', '74d11169-727c-4e7b-91db-c931400bcb27', '768cc66a-ba30-4bd5-a492-e28ccb795968'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:07:06 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Delete snapshot completed successfully. Sep 03 20:07:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-61b5dc14-a4d3-4605-9bdf-36185005e9a0 req-5ec53570-2fb1-4cd2-9179-b87f75058301 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "cinder-dc6e6034-9ee2-4bff-b4d7-d28291cf2a6c-delete_snapshot" released by "delete_snapshot" :: held 2.836s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Acquiring lock "cinder-74c737c7-7cd3-40a2-9222-70264da9de62-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "cinder-74c737c7-7cd3-40a2-9222-70264da9de62-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Acquiring lock "cinder-quobyte-74c737c7-7cd3-40a2-9222-70264da9de62" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "cinder-quobyte-74c737c7-7cd3-40a2-9222-70264da9de62" acquired by "delete_volume" :: waited 0.040s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:07 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcf79b7-02a7-40fd-85d7-4fbfc504c956]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:08 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62 Sep 03 20:07:08 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:08 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62" returned: 0 in 0.572s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:08 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62 Sep 03 20:07:08 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-3f9b1990-0f50-4df0-81e7-0b22d7ffe45a req-759bef12-a403-4f4c-911e-104a636e596c tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-3f9b1990-0f50-4df0-81e7-0b22d7ffe45a req-759bef12-a403-4f4c-911e-104a636e596c tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-3f9b1990-0f50-4df0-81e7-0b22d7ffe45a req-759bef12-a403-4f4c-911e-104a636e596c tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3f9b1990-0f50-4df0-81e7-0b22d7ffe45a req-759bef12-a403-4f4c-911e-104a636e596c tempest-ServerActionsTestOtherA-1138108255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-72081664-b977-457a-a7c9-12b81f297df7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d51fe70-aad7-4fd9-9b9d-d7eb82df2914', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:07:08 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-74c737c7-7cd3-40a2-9222-70264da9de62" returned: 0 in 0.261s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "cinder-quobyte-74c737c7-7cd3-40a2-9222-70264da9de62" released by "delete_volume" :: held 0.948s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-3f9b1990-0f50-4df0-81e7-0b22d7ffe45a req-759bef12-a403-4f4c-911e-104a636e596c tempest-ServerActionsTestOtherA-1138108255 None] attachment_update completed successfully. Sep 03 20:07:08 devstack cinder-volume[87582]: DEBUG cinder.quota [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Created reservations ['bd43d842-b784-4135-951f-8f4b2d26faaa', '612e0e54-821c-4ee9-a988-120ff1d9883f', '65844f82-19bc-408d-b20a-1a274cd11393', 'a0817c6d-39a0-4a7d-8a9b-5780cb9e00f7'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:07:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:09 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:07:09 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:09 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.556s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:09 devstack cinder-volume[87582]: DEBUG cinder.manager [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:07:09 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Deleted volume successfully. Sep 03 20:07:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-229ba40d-f927-4243-80f5-d5181fd3e786 req-093e31b2-3f50-4aaa-91c0-2cd4d63cb3d7 tempest-VolumesSnapshotsTestJSON-308918127 None] Lock "cinder-74c737c7-7cd3-40a2-9222-70264da9de62-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:14 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-34c4c1c5-b289-46b2-91f2-1aea7c4fb4fa req-5a2100d9-6f7c-468c-a21d-8889c397a285 tempest-ServerActionsTestOtherA-1138108255 None] Terminate volume connection completed successfully. Sep 03 20:07:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-34c4c1c5-b289-46b2-91f2-1aea7c4fb4fa req-5a2100d9-6f7c-468c-a21d-8889c397a285 tempest-ServerActionsTestOtherA-1138108255 None] Deleting attachment 2d51fe70-aad7-4fd9-9b9d-d7eb82df2914. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:07:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-34c4c1c5-b289-46b2-91f2-1aea7c4fb4fa req-6c0b6fa5-132c-4021-a28f-92e4f710566f tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-34c4c1c5-b289-46b2-91f2-1aea7c4fb4fa req-6c0b6fa5-132c-4021-a28f-92e4f710566f tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-34c4c1c5-b289-46b2-91f2-1aea7c4fb4fa req-6c0b6fa5-132c-4021-a28f-92e4f710566f tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-34c4c1c5-b289-46b2-91f2-1aea7c4fb4fa req-6c0b6fa5-132c-4021-a28f-92e4f710566f tempest-ServerActionsTestOtherA-1138108255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-72081664-b977-457a-a7c9-12b81f297df7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cc60398-14e6-47f0-ac15-d4f2587bbf5a', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:07:15 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-34c4c1c5-b289-46b2-91f2-1aea7c4fb4fa req-6c0b6fa5-132c-4021-a28f-92e4f710566f tempest-ServerActionsTestOtherA-1138108255 None] attachment_update completed successfully. Sep 03 20:07:21 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2deed507-a02c-4932-b83e-cd943669e9dd tempest-GroupSnapshotsTest-2014842171 None] Group tempest-GroupSnapshotsTest-Group-509869070: creating Sep 03 20:07:21 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2deed507-a02c-4932-b83e-cd943669e9dd tempest-GroupSnapshotsTest-2014842171 None] Group tempest-GroupSnapshotsTest-Group-509869070: created successfully Sep 03 20:07:21 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2deed507-a02c-4932-b83e-cd943669e9dd tempest-GroupSnapshotsTest-2014842171 None] Create group completed successfully. Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Flow 'volume_create_manager' (97b0a4e0-d8cf-4094-9416-83625588c103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e9c829-cf85-4c55-ab12-cceaee665cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e9c829-cf85-4c55-ab12-cceaee665cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2063672803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e35caa58-8d58-4ca0-8ccd-fc66b366cba7,host='devstack@QuobyteHD#QuobyteHD',id=364e6a12-569b-46c7-86dd-508777c1e7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d54b3893f94e66bd9d8c69ab42f425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:24Z,use_quota=True,user_id='a7c12fd4bd0348579f2a7aa3194ecfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(697501e9-92c3-43bd-9196-399e66c36333),volume_type_id=697501e9-92c3-43bd-9196-399e66c36333)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e61503-4aeb-4d47-bba0-73df89d09fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e61503-4aeb-4d47-bba0-73df89d09fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39c4240-b195-4055-9c8f-5d8639a0c996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39c4240-b195-4055-9c8f-5d8639a0c996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '364e6a12-569b-46c7-86dd-508777c1e7f7', 'volume_name': 'volume-364e6a12-569b-46c7-86dd-508777c1e7f7', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d87a68-4ff5-44cc-94cc-fb6e0aa7f1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d87a68-4ff5-44cc-94cc-fb6e0aa7f1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042656e1-b889-4bb9-b000-2aa7c425dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:23 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Volume 364e6a12-569b-46c7-86dd-508777c1e7f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-364e6a12-569b-46c7-86dd-508777c1e7f7', 'volume_size': 1} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e35caa58-8d58-4ca0-8ccd-fc66b366cba7,created_at=2026-09-03T18:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2063672803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e35caa58-8d58-4ca0-8ccd-fc66b366cba7,host='devstack@QuobyteHD#QuobyteHD',id=364e6a12-569b-46c7-86dd-508777c1e7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d54b3893f94e66bd9d8c69ab42f425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:24Z,use_quota=True,user_id='a7c12fd4bd0348579f2a7aa3194ecfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(697501e9-92c3-43bd-9196-399e66c36333),volume_type_id=697501e9-92c3-43bd-9196-399e66c36333)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Creating volume 364e6a12-569b-46c7-86dd-508777c1e7f7 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:07:23 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:07:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:23 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 1073741824 Sep 03 20:07:23 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:24 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 1073741824" returned: 0 in 0.523s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:24 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 Sep 03 20:07:24 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:24 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7" returned: 0 in 0.288s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:07:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042656e1-b889-4bb9-b000-2aa7c425dc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364e6a12-569b-46c7-86dd-508777c1e7f7', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ebf8f8-6f5f-4fe7-b87d-bd13f9791962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:24 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Volume volume-364e6a12-569b-46c7-86dd-508777c1e7f7 (364e6a12-569b-46c7-86dd-508777c1e7f7): created successfully Sep 03 20:07:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ebf8f8-6f5f-4fe7-b87d-bd13f9791962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Flow 'volume_create_manager' (97b0a4e0-d8cf-4094-9416-83625588c103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:24 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-1790c5ad-fc93-46df-be74-8f46882008cb tempest-GroupSnapshotsTest-2014842171 None] Created volume successfully. Sep 03 20:07:25 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] GroupSnapshot b726d620-6b87-464d-bbc0-dbb0d8251c67: creating. Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] Group snapshot b726d620-6b87-464d-bbc0-dbb0d8251c67: creating. {{(pid=87582) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] Creating offline snapshot af839475-d320-4c76-ab8d-7c8ffd125644 of volume 364e6a12-569b-46c7-86dd-508777c1e7f7 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce35570-7dc3-4aaa-8d68-17ea3cc6d3c3]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:25 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 Sep 03 20:07:25 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Flow 'volume_create_manager' (2d7a2a1e-4f50-4c81-a57f-b4567a9f0653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499102b8-da5b-4925-969c-e2b1044c9245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499102b8-da5b-4925-969c-e2b1044c9245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1876570398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e38db76-6a8c-44f5-9255-afa6aa57903f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7025d69b29904391a97b529168c9626e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:25Z,use_quota=True,user_id='b43592d2b7ba458597443cda4e902a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcceee16-503a-4910-af97-f919435f6509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcceee16-503a-4910-af97-f919435f6509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbec9536-e72f-4c8d-b26b-55be9368cd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbec9536-e72f-4c8d-b26b-55be9368cd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e38db76-6a8c-44f5-9255-afa6aa57903f', 'volume_name': 'volume-0e38db76-6a8c-44f5-9255-afa6aa57903f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d173cdbc-49da-4eb7-84c4-7c7a3ee2c636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d173cdbc-49da-4eb7-84c4-7c7a3ee2c636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4127927b-4d43-45f6-84bc-1556ede932e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:25 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Volume 0e38db76-6a8c-44f5-9255-afa6aa57903f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e38db76-6a8c-44f5-9255-afa6aa57903f', 'volume_size': 1} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:25 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7" returned: 0 in 0.495s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:25 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 1G Sep 03 20:07:25 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:26 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 1G" returned: 0 in 0.426s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364e6a12-569b-46c7-86dd-508777c1e7f7 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:26 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364e6a12-569b-46c7-86dd-508777c1e7f7 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 Sep 03 20:07:26 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:26 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364e6a12-569b-46c7-86dd-508777c1e7f7 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644" returned: 0 in 0.358s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:26 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:07:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:26 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 Sep 03 20:07:26 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:26 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644" returned: 0 in 0.293s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:26 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.info Sep 03 20:07:26 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:27 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.info" returned: 0 in 0.391s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:27 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:27 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.info Sep 03 20:07:27 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:27 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.info" returned: 0 in 0.409s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.520s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.177s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1876570398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e38db76-6a8c-44f5-9255-afa6aa57903f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7025d69b29904391a97b529168c9626e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:25Z,use_quota=True,user_id='b43592d2b7ba458597443cda4e902a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Creating volume 0e38db76-6a8c-44f5-9255-afa6aa57903f {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:07:27 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:07:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0e38db76-6a8c-44f5-9255-afa6aa57903f 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:27 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0e38db76-6a8c-44f5-9255-afa6aa57903f 1073741824 Sep 03 20:07:27 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:27 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-0cad3365-0f6e-470b-be1d-5952f454557d tempest-GroupSnapshotsTest-2014842171 None] group_snapshot b726d620-6b87-464d-bbc0-dbb0d8251c67: created successfully Sep 03 20:07:28 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0e38db76-6a8c-44f5-9255-afa6aa57903f 1073741824" returned: 0 in 0.740s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0e38db76-6a8c-44f5-9255-afa6aa57903f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:28 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0e38db76-6a8c-44f5-9255-afa6aa57903f Sep 03 20:07:28 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:29 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0e38db76-6a8c-44f5-9255-afa6aa57903f" returned: 0 in 0.447s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4127927b-4d43-45f6-84bc-1556ede932e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e38db76-6a8c-44f5-9255-afa6aa57903f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b97390-1b82-432d-82f9-bc6326791f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:29 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Volume volume-0e38db76-6a8c-44f5-9255-afa6aa57903f (0e38db76-6a8c-44f5-9255-afa6aa57903f): created successfully Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b97390-1b82-432d-82f9-bc6326791f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Flow 'volume_create_manager' (2d7a2a1e-4f50-4c81-a57f-b4567a9f0653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:29 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-da338b01-3fd8-41a9-96c6-409f82bd4de8 tempest-VolumesListAdminTestJSON-603976757 None] Created volume successfully. Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-af839475-d320-4c76-ab8d-7c8ffd125644-e06a82ee-811e-4b6c-b68d-62a4c7407419" by "_create_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-af839475-d320-4c76-ab8d-7c8ffd125644-e06a82ee-811e-4b6c-b68d-62a4c7407419" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Creating volume e06a82ee-811e-4b6c-b68d-62a4c7407419 from snapshot af839475-d320-4c76-ab8d-7c8ffd125644 {{(pid=87582) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-e06a82ee-811e-4b6c-b68d-62a4c7407419" by "_copy_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-e06a82ee-811e-4b6c-b68d-62a4c7407419" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] snapshot: af839475-d320-4c76-ab8d-7c8ffd125644, volume: e06a82ee-811e-4b6c-b68d-62a4c7407419, {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[920cddf2-6151-41de-969d-81a10cece08c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:29 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 Sep 03 20:07:29 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:30 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644" returned: 0 in 0.622s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-364e6a12-569b-46c7-86dd-508777c1e7f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[384a6b81-2143-4933-abe3-7389e070ecdd]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:30 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 Sep 03 20:07:30 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Flow 'volume_create_manager' (7ef2c4bc-e4ca-4e8a-ba98-1729bc42369c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31310ec3-d771-4d25-a8c0-3f7eb2fd905c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31310ec3-d771-4d25-a8c0-3f7eb2fd905c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-415996440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805d14e9-b9ab-4847-8f18-20af2c116ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7025d69b29904391a97b529168c9626e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:31Z,use_quota=True,user_id='b43592d2b7ba458597443cda4e902a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4afc43-2075-4631-92ff-0f4042bc5c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4afc43-2075-4631-92ff-0f4042bc5c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa94ab8-5000-4677-b5ca-b5cbda64dafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa94ab8-5000-4677-b5ca-b5cbda64dafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805d14e9-b9ab-4847-8f18-20af2c116ff2', 'volume_name': 'volume-805d14e9-b9ab-4847-8f18-20af2c116ff2', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2ee46c-23c2-4c3f-99e6-f0d70508dfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2ee46c-23c2-4c3f-99e6-f0d70508dfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca32aea-257b-48ca-bf5a-0d323900997b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:30 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Volume 805d14e9-b9ab-4847-8f18-20af2c116ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805d14e9-b9ab-4847-8f18-20af2c116ff2', 'volume_size': 1} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:30 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7" returned: 0 in 0.482s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Creating direct copy from snapshot {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG cinder.utils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Path /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419 not found in is_blk_device check {{(pid=87582) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 20:07:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:30 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419 Sep 03 20:07:30 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:36 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419" returned: 0 in 5.671s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:07:36 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Converted 1024.00 MB image at 180.49 MB/s Sep 03 20:07:36 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:36 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419 Sep 03 20:07:36 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:36 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419" returned: 0 in 0.250s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-e06a82ee-811e-4b6c-b68d-62a4c7407419" released by "_copy_volume_from_snapshot" :: held 7.181s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:36 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:07:36 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-af839475-d320-4c76-ab8d-7c8ffd125644-e06a82ee-811e-4b6c-b68d-62a4c7407419" released by "_create_volume_from_snapshot" :: held 7.298s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.328s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.146s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-415996440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805d14e9-b9ab-4847-8f18-20af2c116ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7025d69b29904391a97b529168c9626e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:31Z,use_quota=True,user_id='b43592d2b7ba458597443cda4e902a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Creating volume 805d14e9-b9ab-4847-8f18-20af2c116ff2 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:07:36 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:07:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-805d14e9-b9ab-4847-8f18-20af2c116ff2 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:36 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-805d14e9-b9ab-4847-8f18-20af2c116ff2 1073741824 Sep 03 20:07:36 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:36 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b3f47053-6f4c-476f-9318-0dd514aff579 tempest-GroupSnapshotsTest-2014842171 None] Create group from source-snapshot-b726d620-6b87-464d-bbc0-dbb0d8251c67 completed successfully. Sep 03 20:07:37 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.271s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 8 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:07:37 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-805d14e9-b9ab-4847-8f18-20af2c116ff2 1073741824" returned: 0 in 0.505s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-805d14e9-b9ab-4847-8f18-20af2c116ff2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:37 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-805d14e9-b9ab-4847-8f18-20af2c116ff2 Sep 03 20:07:37 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:37 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-805d14e9-b9ab-4847-8f18-20af2c116ff2" returned: 0 in 0.246s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca32aea-257b-48ca-bf5a-0d323900997b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805d14e9-b9ab-4847-8f18-20af2c116ff2', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472d817b-94ce-47a1-b980-ec0733daee0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:37 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Volume volume-805d14e9-b9ab-4847-8f18-20af2c116ff2 (805d14e9-b9ab-4847-8f18-20af2c116ff2): created successfully Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472d817b-94ce-47a1-b980-ec0733daee0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Flow 'volume_create_manager' (7ef2c4bc-e4ca-4e8a-ba98-1729bc42369c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:37 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9ccfcfb9-61a2-4ea7-8222-d7e5a5a3dd4a tempest-VolumesListAdminTestJSON-603976757 None] Created volume successfully. Sep 03 20:07:38 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-e06a82ee-811e-4b6c-b68d-62a4c7407419" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:38 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-e06a82ee-811e-4b6c-b68d-62a4c7407419" acquired by "delete_volume" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:38 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d11c16-0044-41ae-9cc0-f0fd9106290a]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:38 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419 Sep 03 20:07:38 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:38 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419" returned: 0 in 0.483s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:38 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419 Sep 03 20:07:38 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Flow 'volume_create_manager' (c490fae8-bef5-47dd-bff3-081acc148fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474d9bd7-e59d-4d11-b85e-2275c4d1312f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474d9bd7-e59d-4d11-b85e-2275c4d1312f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1777718018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3dcfab-405d-4144-9651-82f4d9346798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7025d69b29904391a97b529168c9626e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:39Z,use_quota=True,user_id='b43592d2b7ba458597443cda4e902a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7eb3a40-9324-4102-b6de-ed54790b454d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7eb3a40-9324-4102-b6de-ed54790b454d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f763e9-20d4-4cf5-b93d-157ebbbd45bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f763e9-20d4-4cf5-b93d-157ebbbd45bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3dcfab-405d-4144-9651-82f4d9346798', 'volume_name': 'volume-5e3dcfab-405d-4144-9651-82f4d9346798', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cdad45-6bec-4393-935d-184f2124a4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cdad45-6bec-4393-935d-184f2124a4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4b14a9-e38a-4241-8440-1142261ce42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:39 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Volume 5e3dcfab-405d-4144-9651-82f4d9346798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3dcfab-405d-4144-9651-82f4d9346798', 'volume_size': 1} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:39 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1777718018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3dcfab-405d-4144-9651-82f4d9346798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7025d69b29904391a97b529168c9626e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:39Z,use_quota=True,user_id='b43592d2b7ba458597443cda4e902a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Creating volume 5e3dcfab-405d-4144-9651-82f4d9346798 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:07:39 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5e3dcfab-405d-4144-9651-82f4d9346798 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e06a82ee-811e-4b6c-b68d-62a4c7407419" returned: 0 in 0.410s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:39 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5e3dcfab-405d-4144-9651-82f4d9346798 1073741824 Sep 03 20:07:39 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-e06a82ee-811e-4b6c-b68d-62a4c7407419" released by "delete_volume" :: held 0.966s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Created reservations ['a0a15923-fa56-4f7d-8532-b1fcaf17c469'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:07:39 devstack cinder-volume[87582]: WARNING cinder.quota [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1143487687 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1143487687, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:07:39 devstack cinder-volume[87582]: WARNING cinder.quota [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1143487687 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1143487687, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Created reservations ['51f7f455-b7cf-47f2-99db-3bfab8ff63f1', '414c57f0-c9ba-4ae8-9fb6-38416eeccee7', 'b7e6c2bc-9907-4ad1-814f-ffcb58fa05b8', 'ee3fc1ee-5e36-4b54-a653-a76826616590'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:39 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:07:39 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:39 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5e3dcfab-405d-4144-9651-82f4d9346798 1073741824" returned: 0 in 0.585s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5e3dcfab-405d-4144-9651-82f4d9346798 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:39 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5e3dcfab-405d-4144-9651-82f4d9346798 Sep 03 20:07:39 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:39 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.301s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:39 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:07:39 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-0ca5baab-e4b1-402c-8701-753b6e91865c tempest-GroupSnapshotsTest-2014842171 None] Delete group completed successfully. Sep 03 20:07:40 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5e3dcfab-405d-4144-9651-82f4d9346798" returned: 0 in 0.339s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4b14a9-e38a-4241-8440-1142261ce42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3dcfab-405d-4144-9651-82f4d9346798', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e7d2f8-410b-4852-9c79-7a319e5cd5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:40 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Volume volume-5e3dcfab-405d-4144-9651-82f4d9346798 (5e3dcfab-405d-4144-9651-82f4d9346798): created successfully Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e7d2f8-410b-4852-9c79-7a319e5cd5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Flow 'volume_create_manager' (c490fae8-bef5-47dd-bff3-081acc148fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:40 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-534803ee-cd5f-491a-b36b-2664c0afa1ca tempest-VolumesListAdminTestJSON-603976757 None] Created volume successfully. Sep 03 20:07:40 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] group_snapshot b726d620-6b87-464d-bbc0-dbb0d8251c67: deleting Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] group_snapshot b726d620-6b87-464d-bbc0-dbb0d8251c67: deleting {{(pid=87582) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-364e6a12-569b-46c7-86dd-508777c1e7f7" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-364e6a12-569b-46c7-86dd-508777c1e7f7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-af839475-d320-4c76-ab8d-7c8ffd125644" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-af839475-d320-4c76-ab8d-7c8ffd125644" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Deleting offline snapshot af839475-d320-4c76-ab8d-7c8ffd125644 of volume 364e6a12-569b-46c7-86dd-508777c1e7f7 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] snapshot_file for this snap is: volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ee5b9a-15c7-453a-8893-f01af1f4467b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:40 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 Sep 03 20:07:41 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:41 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644" returned: 0 in 0.490s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-364e6a12-569b-46c7-86dd-508777c1e7f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:07:41 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8166d3f-8ccd-4cfc-a4ff-436ef9a893ec]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:41 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 Sep 03 20:07:41 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:42 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7" returned: 0 in 0.702s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:42 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 Sep 03 20:07:42 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Flow 'volume_create_manager' (c339a06c-230c-4e03-974c-0096fa91c462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94682efa-44c9-4373-b233-67550aeb0bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94682efa-44c9-4373-b233-67550aeb0bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce077408-cf49-45ef-9bf6-108cd4cc3332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ded4b88e7b4e528e49d0e564e3a445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:42Z,use_quota=True,user_id='5596b7deb1c249a88bfbc47d1df203c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e158ccd0-d68d-4d45-9467-823f32b00316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e158ccd0-d68d-4d45-9467-823f32b00316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22db637f-88c5-44a1-9d69-80a75abbd631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22db637f-88c5-44a1-9d69-80a75abbd631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce077408-cf49-45ef-9bf6-108cd4cc3332', 'volume_name': 'volume-ce077408-cf49-45ef-9bf6-108cd4cc3332', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4404f658-c1ae-4f55-989b-342c2775abf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4404f658-c1ae-4f55-989b-342c2775abf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a3147f-39d5-4c7b-945e-07d2c9c4ddf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:42 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Volume ce077408-cf49-45ef-9bf6-108cd4cc3332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce077408-cf49-45ef-9bf6-108cd4cc3332', 'volume_size': 1} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce077408-cf49-45ef-9bf6-108cd4cc3332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ded4b88e7b4e528e49d0e564e3a445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:42Z,use_quota=True,user_id='5596b7deb1c249a88bfbc47d1df203c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Creating volume ce077408-cf49-45ef-9bf6-108cd4cc3332 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:07:42 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ce077408-cf49-45ef-9bf6-108cd4cc3332 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:42 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ce077408-cf49-45ef-9bf6-108cd4cc3332 1073741824 Sep 03 20:07:42 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:42 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644" returned: 0 in 0.552s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:42 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644 Sep 03 20:07:42 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:43 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7.af839475-d320-4c76-ab8d-7c8ffd125644" returned: 0 in 0.775s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-af839475-d320-4c76-ab8d-7c8ffd125644" released by "_delete_snapshot" :: held 2.683s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-364e6a12-569b-46c7-86dd-508777c1e7f7" released by "delete_snapshot" :: held 2.722s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:43 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ce077408-cf49-45ef-9bf6-108cd4cc3332 1073741824" returned: 0 in 0.977s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ce077408-cf49-45ef-9bf6-108cd4cc3332 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:43 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ce077408-cf49-45ef-9bf6-108cd4cc3332 Sep 03 20:07:43 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:43 devstack cinder-volume[87582]: WARNING cinder.quota [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1143487687 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1143487687, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:07:43 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] Created reservations ['32b56a62-e631-4670-b0d2-fd4d38113265', 'd6331324-79fc-4750-ae8b-5b0f025df1a5', 'd427d77b-accf-4194-8cb9-c5294dcbb6c8', '99c0c572-0b55-438a-89f4-daf89427803b'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:07:43 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-838d8e95-f34e-446a-add8-8fe674114dbf tempest-GroupSnapshotsTest-2014842171 None] group_snapshot b726d620-6b87-464d-bbc0-dbb0d8251c67: deleted successfully Sep 03 20:07:44 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ce077408-cf49-45ef-9bf6-108cd4cc3332" returned: 0 in 0.512s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a3147f-39d5-4c7b-945e-07d2c9c4ddf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce077408-cf49-45ef-9bf6-108cd4cc3332', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb0df6c-80d4-4e75-9ff9-3404ddd5aca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:44 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Volume volume-ce077408-cf49-45ef-9bf6-108cd4cc3332 (ce077408-cf49-45ef-9bf6-108cd4cc3332): created successfully Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb0df6c-80d4-4e75-9ff9-3404ddd5aca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Flow 'volume_create_manager' (c339a06c-230c-4e03-974c-0096fa91c462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:44 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8006da0d-8f3d-48cf-88b2-de51ba65e38a tempest-VolumesListAdminTestJSON-682042303 None] Created volume successfully. Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-364e6a12-569b-46c7-86dd-508777c1e7f7" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-364e6a12-569b-46c7-86dd-508777c1e7f7" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c21769e-54c8-4263-919a-033510f8a6d4]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Acquiring lock "cinder-ce077408-cf49-45ef-9bf6-108cd4cc3332-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Lock "cinder-ce077408-cf49-45ef-9bf6-108cd4cc3332-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Acquiring lock "cinder-quobyte-ce077408-cf49-45ef-9bf6-108cd4cc3332" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Lock "cinder-quobyte-ce077408-cf49-45ef-9bf6-108cd4cc3332" acquired by "delete_volume" :: waited 0.042s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fae3bc8-c6d7-4b23-be7e-acfa834345df]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ce077408-cf49-45ef-9bf6-108cd4cc3332 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:45 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 Sep 03 20:07:45 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "cinder-5e3dcfab-405d-4144-9651-82f4d9346798-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:45 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ce077408-cf49-45ef-9bf6-108cd4cc3332 Sep 03 20:07:45 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Lock "cinder-5e3dcfab-405d-4144-9651-82f4d9346798-delete_volume" acquired by "delete_volume" :: waited 0.171s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "cinder-quobyte-5e3dcfab-405d-4144-9651-82f4d9346798" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Lock "cinder-quobyte-5e3dcfab-405d-4144-9651-82f4d9346798" acquired by "delete_volume" :: waited 0.036s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d414cc40-2ca6-4ccc-b8cc-3d272de3058b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5e3dcfab-405d-4144-9651-82f4d9346798 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:45 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-a402e618-3550-4e0d-958e-d258959f273a req-9d3a44d1-924d-47af-8569-73b7b8cd372f tempest-ServerActionsTestOtherA-1138108255 None] Terminate volume connection completed successfully. Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-a402e618-3550-4e0d-958e-d258959f273a req-9d3a44d1-924d-47af-8569-73b7b8cd372f tempest-ServerActionsTestOtherA-1138108255 None] Deleting attachment 6cc60398-14e6-47f0-ac15-d4f2587bbf5a. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:07:45 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7" returned: 0 in 1.025s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:45 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7 Sep 03 20:07:45 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:45 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5e3dcfab-405d-4144-9651-82f4d9346798 Sep 03 20:07:45 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:45 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ce077408-cf49-45ef-9bf6-108cd4cc3332" returned: 0 in 0.758s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ce077408-cf49-45ef-9bf6-108cd4cc3332 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:45 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ce077408-cf49-45ef-9bf6-108cd4cc3332 Sep 03 20:07:45 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:46 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-364e6a12-569b-46c7-86dd-508777c1e7f7" returned: 0 in 0.435s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-364e6a12-569b-46c7-86dd-508777c1e7f7" released by "delete_volume" :: held 1.606s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Created reservations ['30a42b8d-9e83-49e0-af7d-b8400f4f5db2'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:07:46 devstack cinder-volume[87582]: WARNING cinder.db.api [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1143487687'] Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Created reservations ['e888c651-fbd7-4032-bea1-db2f8dbacfb5', '5867c511-e3f2-4a90-ad8c-b4167c5ae51a', 'b61d2513-cbbe-4ee5-9e56-79facb023b75', 'f27ac1c6-dace-4f4f-8a55-49e82f4b1cd9'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:07:46 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5e3dcfab-405d-4144-9651-82f4d9346798" returned: 0 in 0.915s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5e3dcfab-405d-4144-9651-82f4d9346798 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:46 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5e3dcfab-405d-4144-9651-82f4d9346798 Sep 03 20:07:46 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:46 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ce077408-cf49-45ef-9bf6-108cd4cc3332" returned: 0 in 0.835s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:46 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:07:46 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Lock "cinder-quobyte-ce077408-cf49-45ef-9bf6-108cd4cc3332" released by "delete_volume" :: held 1.737s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Created reservations ['a462de3e-a7b0-46af-bd29-58b52d6b7943', '95fa3d38-6f19-4862-b0b9-4ae860dbe9d5', '14250aeb-3f58-41ef-9494-e982d0d7e071', 'f7df5ec6-323e-4b6d-b209-f3d5ed0020a1'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:47 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:07:47 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:47 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5e3dcfab-405d-4144-9651-82f4d9346798" returned: 0 in 0.791s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Lock "cinder-quobyte-5e3dcfab-405d-4144-9651-82f4d9346798" released by "delete_volume" :: held 1.845s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:47 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.804s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:47 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:07:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f0d18d3d-0584-49c7-a9c7-2586e7f878b6 tempest-GroupSnapshotsTest-2014842171 None] Delete group completed successfully. Sep 03 20:07:47 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Created reservations ['24f33026-abef-46d3-9618-009e94d52f8d', 'e7718ec7-4342-4026-9f25-996a9b946781', '73211581-f245-4360-a9e9-1db8fe15f332', '1318d001-7171-4418-8e94-f46b61e81858'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:07:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:47 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:07:47 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:47 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.992s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:47 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:07:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Deleted volume successfully. Sep 03 20:07:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7883a99e-5c10-4cfc-ba31-6f72630ad4f8 tempest-VolumesListAdminTestJSON-682042303 None] Lock "cinder-ce077408-cf49-45ef-9bf6-108cd4cc3332-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "cinder-805d14e9-b9ab-4847-8f18-20af2c116ff2-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Lock "cinder-805d14e9-b9ab-4847-8f18-20af2c116ff2-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "cinder-quobyte-805d14e9-b9ab-4847-8f18-20af2c116ff2" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Lock "cinder-quobyte-805d14e9-b9ab-4847-8f18-20af2c116ff2" acquired by "delete_volume" :: waited 0.075s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:48 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:48 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d197a13a-ebea-4ef7-aa82-d50b8e6a2b2f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-805d14e9-b9ab-4847-8f18-20af2c116ff2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.798s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:48 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:07:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Deleted volume successfully. Sep 03 20:07:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f9f99ffa-af06-465a-89ac-7c14316f1abd tempest-VolumesListAdminTestJSON-603976757 None] Lock "cinder-5e3dcfab-405d-4144-9651-82f4d9346798-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:48 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-805d14e9-b9ab-4847-8f18-20af2c116ff2 Sep 03 20:07:48 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-74726085-465b-4bb3-ab3e-62d4fedaa21c tempest-GroupSnapshotsTest-2014842171 None] Group tempest-GroupSnapshotsTest-Group-1207402149: creating Sep 03 20:07:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-74726085-465b-4bb3-ab3e-62d4fedaa21c tempest-GroupSnapshotsTest-2014842171 None] Group tempest-GroupSnapshotsTest-Group-1207402149: created successfully Sep 03 20:07:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-74726085-465b-4bb3-ab3e-62d4fedaa21c tempest-GroupSnapshotsTest-2014842171 None] Create group completed successfully. Sep 03 20:07:49 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-805d14e9-b9ab-4847-8f18-20af2c116ff2" returned: 0 in 0.573s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-805d14e9-b9ab-4847-8f18-20af2c116ff2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:49 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-805d14e9-b9ab-4847-8f18-20af2c116ff2 Sep 03 20:07:49 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:49 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-805d14e9-b9ab-4847-8f18-20af2c116ff2" returned: 0 in 0.360s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Lock "cinder-quobyte-805d14e9-b9ab-4847-8f18-20af2c116ff2" released by "delete_volume" :: held 1.055s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Created reservations ['ecf6645f-e5df-4d16-b07a-745af6dce41c', 'a16fae45-0d4f-4a9e-8914-2760d1194f75', '23a545cf-c969-4841-9afb-cf9c2b585197', '3bcc2178-117c-48c5-a72b-6c6347a77bbd'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:49 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:07:49 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:49 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.318s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:07:49 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Deleted volume successfully. Sep 03 20:07:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-661e5257-dd7a-4c36-b285-e7724b11fb2c tempest-VolumesListAdminTestJSON-603976757 None] Lock "cinder-805d14e9-b9ab-4847-8f18-20af2c116ff2-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "cinder-0e38db76-6a8c-44f5-9255-afa6aa57903f-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Lock "cinder-0e38db76-6a8c-44f5-9255-afa6aa57903f-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:50 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Flow 'volume_create_manager' (a0f41ca4-2c31-474b-bee1-649a0f200afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c06b43-54d9-40da-aea7-7d1aae2b7b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c06b43-54d9-40da-aea7-7d1aae2b7b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-552234508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d54b7943-8652-4363-84e5-2350ac5cd6a1,host='devstack@QuobyteHD#QuobyteHD',id=00d02fd6-7685-4051-8ba3-eee7dc6d6e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d54b3893f94e66bd9d8c69ab42f425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:51Z,use_quota=True,user_id='a7c12fd4bd0348579f2a7aa3194ecfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9503568-0091-4323-87df-c6dae2a0765d),volume_type_id=b9503568-0091-4323-87df-c6dae2a0765d)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683b3b2d-5eb9-4447-8a85-a4bb9d8b763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683b3b2d-5eb9-4447-8a85-a4bb9d8b763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d941debd-3fa6-4e31-a86b-10b7532fdc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d941debd-3fa6-4e31-a86b-10b7532fdc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d02fd6-7685-4051-8ba3-eee7dc6d6e2a', 'volume_name': 'volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843c98dc-c581-419a-a4bc-8424ebe6330d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843c98dc-c581-419a-a4bc-8424ebe6330d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4051c345-f4d8-4a80-b739-19bdaec054d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:51 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Volume 00d02fd6-7685-4051-8ba3-eee7dc6d6e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a', 'volume_size': 1} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d54b7943-8652-4363-84e5-2350ac5cd6a1,created_at=2026-09-03T18:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-552234508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d54b7943-8652-4363-84e5-2350ac5cd6a1,host='devstack@QuobyteHD#QuobyteHD',id=00d02fd6-7685-4051-8ba3-eee7dc6d6e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d54b3893f94e66bd9d8c69ab42f425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:51Z,use_quota=True,user_id='a7c12fd4bd0348579f2a7aa3194ecfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9503568-0091-4323-87df-c6dae2a0765d),volume_type_id=b9503568-0091-4323-87df-c6dae2a0765d)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Creating volume 00d02fd6-7685-4051-8ba3-eee7dc6d6e2a {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:07:51 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:51 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a 1073741824 Sep 03 20:07:51 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "cinder-quobyte-0e38db76-6a8c-44f5-9255-afa6aa57903f" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Lock "cinder-quobyte-0e38db76-6a8c-44f5-9255-afa6aa57903f" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e890cbe1-93c4-4711-b68e-2d6cc54660a6]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0e38db76-6a8c-44f5-9255-afa6aa57903f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:51 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0e38db76-6a8c-44f5-9255-afa6aa57903f Sep 03 20:07:51 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:51 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a 1073741824" returned: 0 in 0.682s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:51 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0e38db76-6a8c-44f5-9255-afa6aa57903f" returned: 0 in 0.592s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0e38db76-6a8c-44f5-9255-afa6aa57903f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:51 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a Sep 03 20:07:51 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:52 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0e38db76-6a8c-44f5-9255-afa6aa57903f Sep 03 20:07:52 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:52 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a" returned: 0 in 0.293s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:52 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4051c345-f4d8-4a80-b739-19bdaec054d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70533bd4-60b5-4cc9-b591-0245a9cce053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0e38db76-6a8c-44f5-9255-afa6aa57903f" returned: 0 in 0.327s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Lock "cinder-quobyte-0e38db76-6a8c-44f5-9255-afa6aa57903f" released by "delete_volume" :: held 0.997s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:52 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Volume volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a (00d02fd6-7685-4051-8ba3-eee7dc6d6e2a): created successfully Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70533bd4-60b5-4cc9-b591-0245a9cce053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Flow 'volume_create_manager' (a0f41ca4-2c31-474b-bee1-649a0f200afc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-24e5d373-2a00-4456-8848-9201b8457fc6 tempest-GroupSnapshotsTest-2014842171 None] Created volume successfully. Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Created reservations ['1391200f-b019-40ea-9af2-3269ae1f765a', '23f0a68a-e2d4-4be4-9be0-a3ab175237a5', 'e42e57bb-4268-490e-8789-17ac2149db58', '8b74dbc0-1492-476b-8586-520b10e36a73'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:52 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:07:52 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:52 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.287s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:07:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Deleted volume successfully. Sep 03 20:07:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e5734a40-6059-4103-945c-087c85675159 tempest-VolumesListAdminTestJSON-603976757 None] Lock "cinder-0e38db76-6a8c-44f5-9255-afa6aa57903f-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Flow 'volume_create_manager' (65ecc086-b7bd-40c3-8815-a97ebd4e9977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f009349-3302-4ee0-a4e2-a68c2d9461aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f009349-3302-4ee0-a4e2-a68c2d9461aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907276284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d54b7943-8652-4363-84e5-2350ac5cd6a1,host='devstack@QuobyteHD#QuobyteHD',id=85f5850e-77ed-463e-9ce5-4a3c9a8b14c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d54b3893f94e66bd9d8c69ab42f425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:54Z,use_quota=True,user_id='a7c12fd4bd0348579f2a7aa3194ecfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9503568-0091-4323-87df-c6dae2a0765d),volume_type_id=b9503568-0091-4323-87df-c6dae2a0765d)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48c588e-9463-4bf6-90ac-6d89c4cef746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48c588e-9463-4bf6-90ac-6d89c4cef746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c6e020-f8e9-4bbe-a236-8cfa5a98b81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c6e020-f8e9-4bbe-a236-8cfa5a98b81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85f5850e-77ed-463e-9ce5-4a3c9a8b14c3', 'volume_name': 'volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a53fa34-6654-450c-8b10-70398c4c13e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a53fa34-6654-450c-8b10-70398c4c13e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccd4fb2-99d7-460d-8819-c06974e05f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:54 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Volume 85f5850e-77ed-463e-9ce5-4a3c9a8b14c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3', 'volume_size': 1} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d54b7943-8652-4363-84e5-2350ac5cd6a1,created_at=2026-09-03T18:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907276284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d54b7943-8652-4363-84e5-2350ac5cd6a1,host='devstack@QuobyteHD#QuobyteHD',id=85f5850e-77ed-463e-9ce5-4a3c9a8b14c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d54b3893f94e66bd9d8c69ab42f425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:54Z,use_quota=True,user_id='a7c12fd4bd0348579f2a7aa3194ecfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9503568-0091-4323-87df-c6dae2a0765d),volume_type_id=b9503568-0091-4323-87df-c6dae2a0765d)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Creating volume 85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:07:54 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:07:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:54 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 1073741824 Sep 03 20:07:54 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:55 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 1073741824" returned: 0 in 0.543s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:55 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 Sep 03 20:07:55 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:07:55 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Flow 'volume_create_manager' (e7ccfd64-c0a0-4a8b-bd45-d0bcbeb7d1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39517d2-8910-4c0e-94bf-2ead1f5287ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3" returned: 0 in 0.529s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39517d2-8910-4c0e-94bf-2ead1f5287ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-817701436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e633edf6-0068-44bc-9425-ee04cc34090c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52954898c649ffbbd7e30c8c328017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:56Z,use_quota=True,user_id='102794108773457d926b9c21055e0d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07b78a5-0b70-40eb-bd5a-ca8f10af5ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07b78a5-0b70-40eb-bd5a-ca8f10af5ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06587792-5a49-41be-98ff-4c317d30a269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG cinder.image.glance [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Creating Keystone auth plugin from conf {{(pid=87582) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccd4fb2-99d7-460d-8819-c06974e05f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360a1306-032c-4f12-abdb-8ee85ca42859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:55 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Volume volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 (85f5850e-77ed-463e-9ce5-4a3c9a8b14c3): created successfully Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360a1306-032c-4f12-abdb-8ee85ca42859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Flow 'volume_create_manager' (65ecc086-b7bd-40c3-8815-a97ebd4e9977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:07:55 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-989019b5-10bf-416d-b542-25dfdc5b2478 tempest-GroupSnapshotsTest-2014842171 None] Created volume successfully. Sep 03 20:07:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06587792-5a49-41be-98ff-4c317d30a269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e633edf6-0068-44bc-9425-ee04cc34090c', 'volume_name': 'volume-e633edf6-0068-44bc-9425-ee04cc34090c', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2dc269-2d0c-48c2-a836-e8009275ca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2dc269-2d0c-48c2-a836-e8009275ca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:07:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3526ac77-d302-473e-a2f3-9dcbfd4fbf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:07:56 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Volume e633edf6-0068-44bc-9425-ee04cc34090c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e633edf6-0068-44bc-9425-ee04cc34090c', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 20:07:56 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Trying to clone e633edf6-0068-44bc-9425-ee04cc34090c from image 2f677e69-c223-4c71-b630-2245f346f65e at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]). {{(pid=87582) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 20:07:56 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 20:07:56 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Image download 20.69 MB at 20.69 MB/s Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e508d2a3-0f1a-43ad-af72-6379182f745c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:57 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD Sep 03 20:07:57 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:57 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-46c9239c-eaa3-4cb4-9f53-b4cc3a27bd98 tempest-GroupSnapshotsTest-2014842171 None] Update group completed successfully. Sep 03 20:07:57 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Temporary image 2f677e69-c223-4c71-b630-2245f346f65e is fetched for user 102794108773457d926b9c21055e0d87. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[754064c4-192c-4753-b1e6-a970184a7967]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:57 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD Sep 03 20:07:57 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:57 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-817701436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e633edf6-0068-44bc-9425-ee04cc34090c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52954898c649ffbbd7e30c8c328017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:07:56Z,use_quota=True,user_id='102794108773457d926b9c21055e0d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Creating volume e633edf6-0068-44bc-9425-ee04cc34090c {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:07:57 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:07:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:57 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c 1073741824 Sep 03 20:07:57 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:58 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-4ea73334-ffe7-418f-a2a6-656dbc241f73 tempest-GroupSnapshotsTest-2014842171 None] Update group completed successfully. Sep 03 20:07:58 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c 1073741824" returned: 0 in 0.529s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:58 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c Sep 03 20:07:58 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:58 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c" returned: 0 in 0.262s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:07:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:07:58 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Attempting download of 2f677e69-c223-4c71-b630-2245f346f65e ((None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}])) to volume e633edf6-0068-44bc-9425-ee04cc34090c. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 20:07:58 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa44347-2d9c-4905-880b-b80f746126a6]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_fddpd33f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:59 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_fddpd33f Sep 03 20:07:59 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:59 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_fddpd33f" returned: 0 in 0.330s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_fddpd33f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:59 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_fddpd33f Sep 03 20:07:59 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:59 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_fddpd33f" returned: 1 in 0.365s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_fddpd33f' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:07:59 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e19b178-2fa3-4aba-87dc-bbfbe2c0351b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:07:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:59 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2f64e2c3-ff9b-4189-b365-982780a0c3f0 tempest-GroupSnapshotsTest-2014842171 None] Update group completed successfully. Sep 03 20:07:59 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD Sep 03 20:07:59 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:07:59 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Sep 03 20:07:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:07:59 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] 2f677e69-c223-4c71-b630-2245f346f65e was qcow2, converting to qcow2 {{(pid=87582) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 20:07:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:07:59 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c Sep 03 20:08:00 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:00 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=111,cinder:INSERT=26,cinder:UPDATE=117,cinder:DELETE=5 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:08:00 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-89c0e94c-b964-4f1f-9b44-271045bc4170 tempest-GroupSnapshotsTest-2014842171 None] Update group completed successfully. Sep 03 20:08:01 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c" returned: 0 in 1.964s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:01 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_bstt7aqtdevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:08:01 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Converted 112.00 MB image at 56.98 MB/s Sep 03 20:08:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:01 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c 1G Sep 03 20:08:01 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:02 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c 1G" returned: 0 in 0.358s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Downloaded image 2f677e69-c223-4c71-b630-2245f346f65e ((None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}])) to volume e633edf6-0068-44bc-9425-ee04cc34090c successfully. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Temporary image 2f677e69-c223-4c71-b630-2245f346f65e for user 102794108773457d926b9c21055e0d87 is deleted. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Marking volume e633edf6-0068-44bc-9425-ee04cc34090c as bootable. {{(pid=87582) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Copying metadata from image 2f677e69-c223-4c71-b630-2245f346f65e to e633edf6-0068-44bc-9425-ee04cc34090c. {{(pid=87582) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Creating volume glance metadata for volume e633edf6-0068-44bc-9425-ee04cc34090c backed by image 2f677e69-c223-4c71-b630-2245f346f65e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87582) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 20:08:02 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] GroupSnapshot ca302da6-28c9-45b5-8fdf-297dcf656153: creating. Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3526ac77-d302-473e-a2f3-9dcbfd4fbf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e633edf6-0068-44bc-9425-ee04cc34090c', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1958c6e7-82c5-4cea-a4ef-d19dad67ebb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Group snapshot ca302da6-28c9-45b5-8fdf-297dcf656153: creating. {{(pid=87582) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 20:08:02 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Volume volume-e633edf6-0068-44bc-9425-ee04cc34090c (e633edf6-0068-44bc-9425-ee04cc34090c): created successfully Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1958c6e7-82c5-4cea-a4ef-d19dad67ebb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Flow 'volume_create_manager' (e7ccfd64-c0a0-4a8b-bd45-d0bcbeb7d1db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:02 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-df494272-6a7b-425c-9e20-f4f9915d4ca6 tempest-ServerActionsTestOtherA-1138108255 None] Created volume successfully. Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Creating offline snapshot 42c187ac-de19-4dcf-a4b3-7ef21d42ca28 of volume 00d02fd6-7685-4051-8ba3-eee7dc6d6e2a {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[54629893-407d-43bd-bd5d-effaff38c913]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:02 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a Sep 03 20:08:02 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:02 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a" returned: 0 in 0.384s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:02 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 1G Sep 03 20:08:02 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Flow 'volume_create_manager' (7df0e42c-6416-4c58-b13f-49a29ce15cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579dbd42-da19-402c-bba7-90808ecd2acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579dbd42-da19-402c-bba7-90808ecd2acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-442151217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d9148a-7dbb-448b-86ed-d879f0af4e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0056f6ea40474a7aa3b12df9949ced41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:03Z,use_quota=True,user_id='c26c683c900645279724c02478b98726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed5661c-88fa-424e-bc68-954d37dbff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed5661c-88fa-424e-bc68-954d37dbff28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82278e88-5735-4965-bd82-18f3fc808c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82278e88-5735-4965-bd82-18f3fc808c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d9148a-7dbb-448b-86ed-d879f0af4e19', 'volume_name': 'volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae9ee71-b329-4c91-b011-66ac494c2d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae9ee71-b329-4c91-b011-66ac494c2d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392f5315-6763-405b-8ee0-d650bc07338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:03 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Volume a4d9148a-7dbb-448b-86ed-d879f0af4e19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19', 'volume_size': 1} Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:03 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 1G" returned: 0 in 0.585s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:03 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 Sep 03 20:08:03 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:03 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28" returned: 0 in 0.335s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:03 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:08:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:03 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 Sep 03 20:08:03 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:04 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28" returned: 0 in 0.304s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:04 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.info Sep 03 20:08:04 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:04 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.info" returned: 0 in 0.305s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:04 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:08:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:04 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.info Sep 03 20:08:04 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:04 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.info" returned: 0 in 0.314s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Creating offline snapshot e086f1b2-b677-4ea8-ae2a-453b1b237e98 of volume 85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:08:04 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1f07f1-02da-4388-8600-cbac2c7d962e]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:05 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 Sep 03 20:08:05 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:05 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3" returned: 0 in 0.524s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:05 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 1G Sep 03 20:08:05 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-32bf24fe-874a-4476-916b-ade04954e9f1 req-32c072a7-eb3f-40fc-89bf-9ef05dbf3abe tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:05 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 1G" returned: 0 in 0.496s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:06 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 Sep 03 20:08:06 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:06 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98" returned: 0 in 0.321s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:06 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:08:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:06 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 Sep 03 20:08:06 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:06 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98" returned: 0 in 0.286s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:06 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.info Sep 03 20:08:06 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:06 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.info" returned: 0 in 0.251s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:06 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:08:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:06 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.info Sep 03 20:08:06 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:07 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.info" returned: 0 in 0.273s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.667s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-442151217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d9148a-7dbb-448b-86ed-d879f0af4e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0056f6ea40474a7aa3b12df9949ced41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:03Z,use_quota=True,user_id='c26c683c900645279724c02478b98726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Creating volume a4d9148a-7dbb-448b-86ed-d879f0af4e19 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:08:07 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=129,cinder:INSERT=30,cinder:UPDATE=115,cinder:DELETE=10 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:08:07 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19 1073741824 Sep 03 20:08:07 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:07 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f2836044-60af-4902-9747-3429ec983019 tempest-GroupSnapshotsTest-2014842171 None] group_snapshot ca302da6-28c9-45b5-8fdf-297dcf656153: created successfully Sep 03 20:08:07 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19 1073741824" returned: 0 in 0.514s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:07 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19 Sep 03 20:08:07 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:07 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] group_snapshot ca302da6-28c9-45b5-8fdf-297dcf656153: deleting Sep 03 20:08:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] group_snapshot ca302da6-28c9-45b5-8fdf-297dcf656153: deleting {{(pid=87582) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:08 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19" returned: 0 in 0.290s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-32bf24fe-874a-4476-916b-ade04954e9f1 req-32c072a7-eb3f-40fc-89bf-9ef05dbf3abe tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.141s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-42c187ac-de19-4dcf-a4b3-7ef21d42ca28" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392f5315-6763-405b-8ee0-d650bc07338e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f0767a-5d55-4e51-9aca-0b94320c68eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-42c187ac-de19-4dcf-a4b3-7ef21d42ca28" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Deleting offline snapshot 42c187ac-de19-4dcf-a4b3-7ef21d42ca28 of volume 00d02fd6-7685-4051-8ba3-eee7dc6d6e2a {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] snapshot_file for this snap is: volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-32bf24fe-874a-4476-916b-ade04954e9f1 req-32c072a7-eb3f-40fc-89bf-9ef05dbf3abe tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.076s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:08 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Volume volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19 (a4d9148a-7dbb-448b-86ed-d879f0af4e19): created successfully Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f0767a-5d55-4e51-9aca-0b94320c68eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Flow 'volume_create_manager' (7df0e42c-6416-4c58-b13f-49a29ce15cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f54ee2c-1f49-415f-8bce-029f755e87e8]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9583e42e-9151-478d-b69d-76e2591f660b tempest-VolumesTransfersV355Test-208790774 None] Created volume successfully. Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-32bf24fe-874a-4476-916b-ade04954e9f1 req-32c072a7-eb3f-40fc-89bf-9ef05dbf3abe tempest-ServerActionsTestOtherA-1138108255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-e633edf6-0068-44bc-9425-ee04cc34090c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b1e245a-94b0-4316-a3d1-370e859147ee', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:08:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-32bf24fe-874a-4476-916b-ade04954e9f1 req-32c072a7-eb3f-40fc-89bf-9ef05dbf3abe tempest-ServerActionsTestOtherA-1138108255 None] attachment_update completed successfully. Sep 03 20:08:08 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 Sep 03 20:08:08 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:08 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28" returned: 0 in 0.438s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[285b2445-32da-4d24-98bb-bfbf6f5a4e0b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:08 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a Sep 03 20:08:08 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:09 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a" returned: 0 in 0.595s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:09 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 Sep 03 20:08:09 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:09 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28" returned: 0 in 0.505s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:09 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28 Sep 03 20:08:09 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:09 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5f0cb2e8-aa33-4199-b987-018d56cb234f tempest-VolumesTransfersV355Test-285060724 None] Transfer volume completed successfully. Sep 03 20:08:10 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a.42c187ac-de19-4dcf-a4b3-7ef21d42ca28" returned: 0 in 0.377s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-42c187ac-de19-4dcf-a4b3-7ef21d42ca28" released by "_delete_snapshot" :: held 2.063s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a" released by "delete_snapshot" :: held 2.124s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-e086f1b2-b677-4ea8-ae2a-453b1b237e98" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-e086f1b2-b677-4ea8-ae2a-453b1b237e98" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Deleting offline snapshot e086f1b2-b677-4ea8-ae2a-453b1b237e98 of volume 85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] snapshot_file for this snap is: volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[138512c5-2bb4-4631-bbc4-678a5d77f405]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:10 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 Sep 03 20:08:10 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Acquiring lock "cinder-a4d9148a-7dbb-448b-86ed-d879f0af4e19-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Lock "cinder-a4d9148a-7dbb-448b-86ed-d879f0af4e19-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Acquiring lock "cinder-quobyte-a4d9148a-7dbb-448b-86ed-d879f0af4e19" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Lock "cinder-quobyte-a4d9148a-7dbb-448b-86ed-d879f0af4e19" acquired by "delete_volume" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c5c2da-21f1-4e4f-bc52-fbdd0969c14d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Flow 'volume_create_manager' (3215b8f8-ec2f-4365-821f-c9ab1e9f6753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a36c04-176b-4a57-976b-434de8c07f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a36c04-176b-4a57-976b-434de8c07f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1973750778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c742e68-b93c-420f-aaef-3c0334022b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b1157453464404ab4c63ce241f7b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:11Z,use_quota=True,user_id='37dfe25c9ba042399c53ead252a110c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13cf550-72e5-43e0-b0dc-9ee5a2d3e5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13cf550-72e5-43e0-b0dc-9ee5a2d3e5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:10 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:10 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19 Sep 03 20:08:10 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a64211-242c-432c-90a9-fd8379cbaa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a64211-242c-432c-90a9-fd8379cbaa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c742e68-b93c-420f-aaef-3c0334022b33', 'volume_name': 'volume-0c742e68-b93c-420f-aaef-3c0334022b33', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d895e0e8-b154-4512-816a-7351f3eafcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d895e0e8-b154-4512-816a-7351f3eafcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b5c3d8-47be-42e4-8d5b-c4946edb07ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:10 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Volume 0c742e68-b93c-420f-aaef-3c0334022b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c742e68-b93c-420f-aaef-3c0334022b33', 'volume_size': 1} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1973750778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c742e68-b93c-420f-aaef-3c0334022b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b1157453464404ab4c63ce241f7b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:11Z,use_quota=True,user_id='37dfe25c9ba042399c53ead252a110c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Creating volume 0c742e68-b93c-420f-aaef-3c0334022b33 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:08:10 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c742e68-b93c-420f-aaef-3c0334022b33 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98" returned: 0 in 0.637s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:08:11 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c742e68-b93c-420f-aaef-3c0334022b33 1073741824 Sep 03 20:08:11 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:11 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7851acb2-4ffc-471d-bea0-7f18703fc716]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:11 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 Sep 03 20:08:11 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:11 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19" returned: 0 in 0.670s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:11 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19 Sep 03 20:08:11 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:11 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c742e68-b93c-420f-aaef-3c0334022b33 1073741824" returned: 0 in 0.763s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:11 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3" returned: 0 in 0.734s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:11 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 Sep 03 20:08:11 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c742e68-b93c-420f-aaef-3c0334022b33 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:11 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a4d9148a-7dbb-448b-86ed-d879f0af4e19" returned: 0 in 0.430s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:11 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c742e68-b93c-420f-aaef-3c0334022b33 Sep 03 20:08:11 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:11 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Lock "cinder-quobyte-a4d9148a-7dbb-448b-86ed-d879f0af4e19" released by "delete_volume" :: held 1.173s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Created reservations ['1bfb9983-b4a7-425f-8165-e3b2d75314e4', 'd72dc1f4-487e-41c2-80c6-6a79d43c89fd', '47e4d6e2-1700-44cc-b4a1-614659c8cb2b', 'f2ffb2d0-0c7f-455b-bdec-f6e9cd4a78fb'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:12 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:08:12 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:12 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c742e68-b93c-420f-aaef-3c0334022b33" returned: 0 in 0.452s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b5c3d8-47be-42e4-8d5b-c4946edb07ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c742e68-b93c-420f-aaef-3c0334022b33', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714f36e6-0cb2-48ca-9ea6-d39889631e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:12 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Volume volume-0c742e68-b93c-420f-aaef-3c0334022b33 (0c742e68-b93c-420f-aaef-3c0334022b33): created successfully Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714f36e6-0cb2-48ca-9ea6-d39889631e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Flow 'volume_create_manager' (3215b8f8-ec2f-4365-821f-c9ab1e9f6753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:12 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:12 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d18ee028-d3e6-4cbb-aa9a-9e04f410f9bc tempest-AttachVolumeTestJSON-136447603 None] Created volume successfully. Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98" returned: 0 in 0.628s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:12 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98 Sep 03 20:08:12 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:12 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.439s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:08:12 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Deleted volume successfully. Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a3d42baf-fbd8-49f7-b123-dec9c9194cfd tempest-VolumesTransfersV355Test-837275577 None] Lock "cinder-a4d9148a-7dbb-448b-86ed-d879f0af4e19-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:12 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3.e086f1b2-b677-4ea8-ae2a-453b1b237e98" returned: 0 in 0.354s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-e086f1b2-b677-4ea8-ae2a-453b1b237e98" released by "_delete_snapshot" :: held 2.550s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3" released by "delete_snapshot" :: held 2.610s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:12 devstack cinder-volume[87582]: WARNING cinder.quota [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1283542917 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1283542917, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:08:12 devstack cinder-volume[87582]: WARNING cinder.quota [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1283542917 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1283542917, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:08:12 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Created reservations ['9cc295d1-94a0-4db4-ae06-ed99ec4db9aa', '3167b15d-c169-4c9f-9272-1c5fa0ea9d74', 'b2f10d18-4502-4fb0-a153-88f0b4c1353a', 'd07edab2-edbc-4009-ad6e-de36285b0fe7'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:13 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] Created reservations ['4bd08029-208d-4657-8630-b92bb2a61866', 'bfec276c-3107-400e-9597-a84a537b5187', '2a8f8385-d688-40a3-8fdc-82bdb14e37d9', '2e459c79-ad8a-4485-abc5-336238d42529'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:13 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b1c0418a-7cfd-4c73-b977-10023a658626 tempest-GroupSnapshotsTest-2014842171 None] group_snapshot ca302da6-28c9-45b5-8fdf-297dcf656153: deleted successfully Sep 03 20:08:13 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Flow 'volume_create_manager' (3d2da38c-44d6-4841-aa6b-fd0a5db569f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4dfbc9-08f9-424a-a452-9ce3647beb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4dfbc9-08f9-424a-a452-9ce3647beb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1484225052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5921f9-4146-4604-b0e3-4a420320347a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0056f6ea40474a7aa3b12df9949ced41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:14Z,use_quota=True,user_id='c26c683c900645279724c02478b98726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e7f938-0d92-43c5-9ef1-b489755a75f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e7f938-0d92-43c5-9ef1-b489755a75f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0f3248-73ba-48ba-aef6-f4387d9b688c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0f3248-73ba-48ba-aef6-f4387d9b688c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a5921f9-4146-4604-b0e3-4a420320347a', 'volume_name': 'volume-5a5921f9-4146-4604-b0e3-4a420320347a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f9057a-3456-4b6a-aa53-97b7b6181d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f9057a-3456-4b6a-aa53-97b7b6181d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9eb8cc-1e8a-4713-b3bd-8978cdadd128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:14 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Volume 5a5921f9-4146-4604-b0e3-4a420320347a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a5921f9-4146-4604-b0e3-4a420320347a', 'volume_size': 1} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1484225052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5921f9-4146-4604-b0e3-4a420320347a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0056f6ea40474a7aa3b12df9949ced41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:14Z,use_quota=True,user_id='c26c683c900645279724c02478b98726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Creating volume 5a5921f9-4146-4604-b0e3-4a420320347a {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:08:14 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5a5921f9-4146-4604-b0e3-4a420320347a 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:14 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5a5921f9-4146-4604-b0e3-4a420320347a 1073741824 Sep 03 20:08:14 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-36e22bc2-7550-4047-bcb3-1cc2d92db50b req-c441f90f-035f-4d0c-a368-9cabae2d3e41 tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a" acquired by "delete_volume" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a804033e-c827-460a-9c0f-c1df41d09c46]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:14 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a Sep 03 20:08:14 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:14 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5a5921f9-4146-4604-b0e3-4a420320347a 1073741824" returned: 0 in 0.623s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5a5921f9-4146-4604-b0e3-4a420320347a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:15 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5a5921f9-4146-4604-b0e3-4a420320347a Sep 03 20:08:15 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:15 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a" returned: 0 in 0.689s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:15 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a Sep 03 20:08:15 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:15 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5a5921f9-4146-4604-b0e3-4a420320347a" returned: 0 in 0.427s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-36e22bc2-7550-4047-bcb3-1cc2d92db50b req-c441f90f-035f-4d0c-a368-9cabae2d3e41 tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.064s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9eb8cc-1e8a-4713-b3bd-8978cdadd128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a5921f9-4146-4604-b0e3-4a420320347a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87083c51-1308-4fe1-b89d-18b14c72f1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-36e22bc2-7550-4047-bcb3-1cc2d92db50b req-c441f90f-035f-4d0c-a368-9cabae2d3e41 tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:15 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Volume volume-5a5921f9-4146-4604-b0e3-4a420320347a (5a5921f9-4146-4604-b0e3-4a420320347a): created successfully Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87083c51-1308-4fe1-b89d-18b14c72f1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Flow 'volume_create_manager' (3d2da38c-44d6-4841-aa6b-fd0a5db569f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:15 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8105b546-1f80-413b-a5c9-d2bfb6d646f3 tempest-VolumesTransfersV355Test-208790774 None] Created volume successfully. Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-36e22bc2-7550-4047-bcb3-1cc2d92db50b req-c441f90f-035f-4d0c-a368-9cabae2d3e41 tempest-AttachVolumeTestJSON-136447603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-0c742e68-b93c-420f-aaef-3c0334022b33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b8e40a7-b236-443e-87ce-06d613bdaf47', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:08:15 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-36e22bc2-7550-4047-bcb3-1cc2d92db50b req-c441f90f-035f-4d0c-a368-9cabae2d3e41 tempest-AttachVolumeTestJSON-136447603 None] attachment_update completed successfully. Sep 03 20:08:15 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a" returned: 0 in 0.439s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-00d02fd6-7685-4051-8ba3-eee7dc6d6e2a" released by "delete_volume" :: held 1.234s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3" acquired by "delete_volume" :: waited 0.036s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d85183-53d3-44f0-a3d3-8bf693a710f7]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:16 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 Sep 03 20:08:16 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:16 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3" returned: 0 in 0.765s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:16 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3 Sep 03 20:08:16 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Acquiring lock "cinder-5a5921f9-4146-4604-b0e3-4a420320347a-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Lock "cinder-5a5921f9-4146-4604-b0e3-4a420320347a-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Acquiring lock "cinder-quobyte-5a5921f9-4146-4604-b0e3-4a420320347a" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Lock "cinder-quobyte-5a5921f9-4146-4604-b0e3-4a420320347a" acquired by "delete_volume" :: waited 0.045s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:17 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3" returned: 0 in 0.737s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:17 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2716c9-0b42-4183-92dc-ffa637e94941]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5a5921f9-4146-4604-b0e3-4a420320347a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-85f5850e-77ed-463e-9ce5-4a3c9a8b14c3" released by "delete_volume" :: held 1.651s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:17 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Created reservations ['c7283c27-d406-4576-888a-a77bcacdfdc6'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:17 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5a5921f9-4146-4604-b0e3-4a420320347a Sep 03 20:08:17 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:17 devstack cinder-volume[87582]: WARNING cinder.quota [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1283542917 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1283542917, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:08:17 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Created reservations ['70f4479c-ca6c-4e48-b92c-e81a8b92a635', '383fd23f-b1a1-4f2a-9f05-a29334da6bc7', '7036a768-6069-4563-80cf-e20a386e6255', 'c2b84fe9-5867-4392-97a0-287297ffd283'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:18 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Created reservations ['36db2a75-98b3-4779-b049-304c8f6af286', '7e1ab135-2bab-420d-9ff9-c51904896cad', '28b968f2-9c20-4119-a2bc-5751d0052aee', 'a5b55079-0606-4088-bbf9-53dffc0ae36d'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:18 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5a5921f9-4146-4604-b0e3-4a420320347a" returned: 0 in 0.773s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5a5921f9-4146-4604-b0e3-4a420320347a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:18 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5a5921f9-4146-4604-b0e3-4a420320347a Sep 03 20:08:18 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:18 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:08:18 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:18 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5a5921f9-4146-4604-b0e3-4a420320347a" returned: 0 in 0.622s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Lock "cinder-quobyte-5a5921f9-4146-4604-b0e3-4a420320347a" released by "delete_volume" :: held 1.521s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Created reservations ['cbfa5116-589a-454d-b77f-e7b11563b84c', '6ab62886-8921-4fee-ad1b-aee1eae8acf2', '0e45a0c9-7542-4d9c-81c4-18af0db4ec98', '8be010d5-23b1-4108-90b9-ec40f87e2e0f'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:19 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.587s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:08:19 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-0857db9e-1596-441a-ab08-bd87d22de25b tempest-GroupSnapshotsTest-2014842171 None] Delete group completed successfully. Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:19 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:08:19 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:19 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-98519103-0bd7-45b9-90e8-663ab7ac2025 tempest-GroupSnapshotsTest-2014842171 None] Group tempest-GroupSnapshotsTest-Group-709768605: creating Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Flow 'volume_create_manager' (ef38a140-9caf-47bb-964c-36101e58a211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3c0573-92bf-40e4-a751-e61f72d4ae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:19 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.474s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:08:19 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Deleted volume successfully. Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3c0573-92bf-40e4-a751-e61f72d4ae5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-200598113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2b8835-f3e6-4aa0-8f83-62163f27c923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b1157453464404ab4c63ce241f7b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:19Z,use_quota=True,user_id='37dfe25c9ba042399c53ead252a110c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25e0e88-4c2e-4d86-93d4-2490dd31acde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25e0e88-4c2e-4d86-93d4-2490dd31acde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e79e4bb-6744-4524-bbcf-853eee62f24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e79e4bb-6744-4524-bbcf-853eee62f24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2b8835-f3e6-4aa0-8f83-62163f27c923', 'volume_name': 'volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a07d975-8023-440f-b145-942ee84ccbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a07d975-8023-440f-b145-942ee84ccbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0faf6a-bf2b-4989-9f31-3e6c7031d2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:19 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Volume 2d2b8835-f3e6-4aa0-8f83-62163f27c923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923', 'volume_size': 1} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-200598113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2b8835-f3e6-4aa0-8f83-62163f27c923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b1157453464404ab4c63ce241f7b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:19Z,use_quota=True,user_id='37dfe25c9ba042399c53ead252a110c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Creating volume 2d2b8835-f3e6-4aa0-8f83-62163f27c923 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:08:19 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:19 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923 1073741824 Sep 03 20:08:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c366b5ee-fceb-45d5-8bb6-36e4edb86b24 tempest-VolumesTransfersV355Test-837275577 None] Lock "cinder-5a5921f9-4146-4604-b0e3-4a420320347a-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:19 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:19 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-98519103-0bd7-45b9-90e8-663ab7ac2025 tempest-GroupSnapshotsTest-2014842171 None] Group tempest-GroupSnapshotsTest-Group-709768605: created successfully Sep 03 20:08:19 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-98519103-0bd7-45b9-90e8-663ab7ac2025 tempest-GroupSnapshotsTest-2014842171 None] Create group completed successfully. Sep 03 20:08:20 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923 1073741824" returned: 0 in 0.859s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:20 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923 Sep 03 20:08:20 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:21 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923" returned: 0 in 0.468s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0faf6a-bf2b-4989-9f31-3e6c7031d2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd37eca0-2b22-4944-ba8c-7a125d682ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:21 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Volume volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923 (2d2b8835-f3e6-4aa0-8f83-62163f27c923): created successfully Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd37eca0-2b22-4944-ba8c-7a125d682ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Flow 'volume_create_manager' (ef38a140-9caf-47bb-964c-36101e58a211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:21 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-aad5b89f-89cd-47b8-a187-eed210825667 tempest-AttachVolumeTestJSON-136447603 None] Created volume successfully. Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Flow 'volume_create_manager' (9a7a5ad7-dbd0-423c-b139-18908ee54a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f1d1f1-5b3d-47b3-b8a5-905c4cf1d995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f1d1f1-5b3d-47b3-b8a5-905c4cf1d995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-514657069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c88adc7d-94c6-40e7-8e09-c7da480ceaad,host='devstack@QuobyteHD#QuobyteHD',id=3adb43b5-5557-41c3-a9e5-fbe0e3577595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d54b3893f94e66bd9d8c69ab42f425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:21Z,use_quota=True,user_id='a7c12fd4bd0348579f2a7aa3194ecfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6223439e-a5e4-4e6a-b827-5d4040aaac76),volume_type_id=6223439e-a5e4-4e6a-b827-5d4040aaac76)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed353f9c-cd63-42ed-8a7c-23d0b1d00348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed353f9c-cd63-42ed-8a7c-23d0b1d00348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222e2a9f-6a1a-4396-a954-0324c1ea499a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222e2a9f-6a1a-4396-a954-0324c1ea499a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3adb43b5-5557-41c3-a9e5-fbe0e3577595', 'volume_name': 'volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77863f0c-2004-45b1-bbcc-f602f81392ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77863f0c-2004-45b1-bbcc-f602f81392ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e03f102-41cf-42e0-8c94-96b6b79d8338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:21 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Volume 3adb43b5-5557-41c3-a9e5-fbe0e3577595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595', 'volume_size': 1} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c88adc7d-94c6-40e7-8e09-c7da480ceaad,created_at=2026-09-03T18:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-514657069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c88adc7d-94c6-40e7-8e09-c7da480ceaad,host='devstack@QuobyteHD#QuobyteHD',id=3adb43b5-5557-41c3-a9e5-fbe0e3577595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d54b3893f94e66bd9d8c69ab42f425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:21Z,use_quota=True,user_id='a7c12fd4bd0348579f2a7aa3194ecfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6223439e-a5e4-4e6a-b827-5d4040aaac76),volume_type_id=6223439e-a5e4-4e6a-b827-5d4040aaac76)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Creating volume 3adb43b5-5557-41c3-a9e5-fbe0e3577595 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:08:21 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:08:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:21 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 1073741824 Sep 03 20:08:21 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:22 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 1073741824" returned: 0 in 0.883s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:22 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 Sep 03 20:08:22 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:23 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595" returned: 0 in 0.386s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:08:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-592c2c25-d876-4436-9390-e5fd95d40ca7 req-7286bc52-436a-468c-bd2c-581c5d2dbb1d tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-592c2c25-d876-4436-9390-e5fd95d40ca7 req-7286bc52-436a-468c-bd2c-581c5d2dbb1d tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e03f102-41cf-42e0-8c94-96b6b79d8338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1310cc6f-8882-4154-91ba-b73f6fd1fffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-592c2c25-d876-4436-9390-e5fd95d40ca7 req-7286bc52-436a-468c-bd2c-581c5d2dbb1d tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:23 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Volume volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 (3adb43b5-5557-41c3-a9e5-fbe0e3577595): created successfully Sep 03 20:08:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1310cc6f-8882-4154-91ba-b73f6fd1fffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Flow 'volume_create_manager' (9a7a5ad7-dbd0-423c-b139-18908ee54a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-be0022f4-a97e-4598-ba00-f31d10f9b8b1 tempest-GroupSnapshotsTest-2014842171 None] Created volume successfully. Sep 03 20:08:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-592c2c25-d876-4436-9390-e5fd95d40ca7 req-7286bc52-436a-468c-bd2c-581c5d2dbb1d tempest-AttachVolumeTestJSON-136447603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b687819e-f134-496a-ae68-c8fabfc978a5', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:08:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-592c2c25-d876-4436-9390-e5fd95d40ca7 req-7286bc52-436a-468c-bd2c-581c5d2dbb1d tempest-AttachVolumeTestJSON-136447603 None] attachment_update completed successfully. Sep 03 20:08:24 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-c0c7c851-9a10-4159-bfd8-1cd734b42585 req-7884b9a9-e450-4e93-b2ef-878e6584776f tempest-ServerActionsTestOtherA-1138108255 None] Terminate volume connection completed successfully. Sep 03 20:08:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-c0c7c851-9a10-4159-bfd8-1cd734b42585 req-7884b9a9-e450-4e93-b2ef-878e6584776f tempest-ServerActionsTestOtherA-1138108255 None] Deleting attachment 3b1e245a-94b0-4316-a3d1-370e859147ee. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:08:24 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] GroupSnapshot 9da41302-c35e-44fd-8b21-5b1d03116928: creating. Sep 03 20:08:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] Group snapshot 9da41302-c35e-44fd-8b21-5b1d03116928: creating. {{(pid=87582) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 20:08:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] Creating offline snapshot 8b8000a2-bd33-4b42-bc87-8c1893d29eec of volume 3adb43b5-5557-41c3-a9e5-fbe0e3577595 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:08:24 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fee2c7-7a84-40ee-83ea-9e08594ff25d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:25 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 Sep 03 20:08:25 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:25 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595" returned: 0 in 0.519s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:25 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec 1G Sep 03 20:08:25 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:26 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec 1G" returned: 0 in 0.625s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:26 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec Sep 03 20:08:26 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:26 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-393c581e-417b-4956-9615-4ce00b5b678e req-c2067b44-6b9f-456d-9655-7fb2b451b558 tempest-AttachVolumeTestJSON-136447603 None] Terminate volume connection completed successfully. Sep 03 20:08:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-393c581e-417b-4956-9615-4ce00b5b678e req-c2067b44-6b9f-456d-9655-7fb2b451b558 tempest-AttachVolumeTestJSON-136447603 None] Deleting attachment 9b8e40a7-b236-443e-87ce-06d613bdaf47. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:08:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-c0c7c851-9a10-4159-bfd8-1cd734b42585 req-e7b07183-399b-41c5-a8e6-6622efe5c0e9 tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:26 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec" returned: 0 in 0.518s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:26 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:08:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:26 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec Sep 03 20:08:26 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:26 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec" returned: 0 in 0.328s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:27 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.info Sep 03 20:08:27 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:27 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.info" returned: 0 in 0.299s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:27 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 20:08:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:27 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.info Sep 03 20:08:27 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:27 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.info" returned: 0 in 0.323s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-c0c7c851-9a10-4159-bfd8-1cd734b42585 req-e7b07183-399b-41c5-a8e6-6622efe5c0e9 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.052s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-c0c7c851-9a10-4159-bfd8-1cd734b42585 req-e7b07183-399b-41c5-a8e6-6622efe5c0e9 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-c0c7c851-9a10-4159-bfd8-1cd734b42585 req-e7b07183-399b-41c5-a8e6-6622efe5c0e9 tempest-ServerActionsTestOtherA-1138108255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-e633edf6-0068-44bc-9425-ee04cc34090c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82f974b2-97b2-469c-8da9-7516d8d4aae0', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:08:27 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e058031e-8335-44d9-b58e-5c2044807115 tempest-GroupSnapshotsTest-2014842171 None] group_snapshot 9da41302-c35e-44fd-8b21-5b1d03116928: created successfully Sep 03 20:08:27 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-c0c7c851-9a10-4159-bfd8-1cd734b42585 req-e7b07183-399b-41c5-a8e6-6622efe5c0e9 tempest-ServerActionsTestOtherA-1138108255 None] attachment_update completed successfully. Sep 03 20:08:27 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-c7acf8d2-2de4-474f-89d7-28b4692183af req-a0befca2-c8d7-415b-87ff-19d2c87f383b tempest-AttachVolumeTestJSON-136447603 None] Terminate volume connection completed successfully. Sep 03 20:08:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-c7acf8d2-2de4-474f-89d7-28b4692183af req-a0befca2-c8d7-415b-87ff-19d2c87f383b tempest-AttachVolumeTestJSON-136447603 None] Deleting attachment b687819e-f134-496a-ae68-c8fabfc978a5. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:08:28 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] group_snapshot 9da41302-c35e-44fd-8b21-5b1d03116928: deleting Sep 03 20:08:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] group_snapshot 9da41302-c35e-44fd-8b21-5b1d03116928: deleting {{(pid=87582) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 20:08:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-3adb43b5-5557-41c3-a9e5-fbe0e3577595" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-3adb43b5-5557-41c3-a9e5-fbe0e3577595" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-8b8000a2-bd33-4b42-bc87-8c1893d29eec" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-8b8000a2-bd33-4b42-bc87-8c1893d29eec" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Deleting offline snapshot 8b8000a2-bd33-4b42-bc87-8c1893d29eec of volume 3adb43b5-5557-41c3-a9e5-fbe0e3577595 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:08:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] snapshot_file for this snap is: volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:08:28 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afdd2a7-7bad-48ce-ad72-8db5c811c38c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:28 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec Sep 03 20:08:28 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:29 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec" returned: 0 in 0.824s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:08:29 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[573f5bc4-c8fc-4ab6-9e24-b428482d7bff]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:29 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 Sep 03 20:08:29 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:30 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595" returned: 0 in 0.665s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:30 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec Sep 03 20:08:30 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Flow 'volume_create_manager' (d7e7f46b-45e2-4645-9f9d-783a8bd1c83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f54c41-df9a-4d07-96af-aca7db88f0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f54c41-df9a-4d07-96af-aca7db88f0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1991124858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ed1a3d-7a1a-4399-b940-5af29c0c970a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42bf98b12da4ef79c7a3f91b558fdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:31Z,use_quota=True,user_id='f36e30a1918843c89d72c37c5ef95ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d94944-f47e-407b-8653-13a24c615ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d94944-f47e-407b-8653-13a24c615ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa54125-fe09-4bac-aad8-92bf0f13cab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa54125-fe09-4bac-aad8-92bf0f13cab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45ed1a3d-7a1a-4399-b940-5af29c0c970a', 'volume_name': 'volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ebc2b66-18e5-4593-8b15-b63a4bac0617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ebc2b66-18e5-4593-8b15-b63a4bac0617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e211c0-ff5f-419e-ba45-f7deaf3c5b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:30 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Volume 45ed1a3d-7a1a-4399-b940-5af29c0c970a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a', 'volume_size': 1} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1991124858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ed1a3d-7a1a-4399-b940-5af29c0c970a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42bf98b12da4ef79c7a3f91b558fdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:31Z,use_quota=True,user_id='f36e30a1918843c89d72c37c5ef95ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Creating volume 45ed1a3d-7a1a-4399-b940-5af29c0c970a {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:08:30 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:30 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a 1073741824 Sep 03 20:08:30 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:30 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec" returned: 0 in 0.794s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:30 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec Sep 03 20:08:30 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595.8b8000a2-bd33-4b42-bc87-8c1893d29eec" returned: 0 in 0.815s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:31 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-8b8000a2-bd33-4b42-bc87-8c1893d29eec" released by "_delete_snapshot" :: held 3.286s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-3adb43b5-5557-41c3-a9e5-fbe0e3577595" released by "delete_snapshot" :: held 3.337s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:31 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a 1073741824" returned: 0 in 1.022s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:31 devstack cinder-volume[87582]: WARNING cinder.quota [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2106641720 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2106641720, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:08:31 devstack cinder-volume[87582]: WARNING cinder.quota [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2106641720 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2106641720, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:08:31 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a Sep 03 20:08:31 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:32 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] Created reservations ['a0d45f18-7405-4dc3-b874-24f2194a6704', 'a8682bfd-4d9b-48b4-90f6-a4cb6556a29b', 'ff6c160f-61d9-4a23-9b83-3d35edfd97b0', 'c653202b-fad3-4cb9-94d1-5c48cbc7059f'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:32 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-dfee32bb-8e5b-49d3-94f3-5afe2d874c65 tempest-GroupSnapshotsTest-2014842171 None] group_snapshot 9da41302-c35e-44fd-8b21-5b1d03116928: deleted successfully Sep 03 20:08:32 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a" returned: 0 in 0.455s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:08:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e211c0-ff5f-419e-ba45-f7deaf3c5b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d5a52d-2a82-4bf2-bcfe-bc647c038e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:32 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Volume volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a (45ed1a3d-7a1a-4399-b940-5af29c0c970a): created successfully Sep 03 20:08:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d5a52d-2a82-4bf2-bcfe-bc647c038e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Flow 'volume_create_manager' (d7e7f46b-45e2-4645-9f9d-783a8bd1c83d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:32 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-dc5c1902-647c-49d5-a52b-f7cdec9fbed9 tempest-VolumesCloneTest-1845392326 None] Created volume successfully. Sep 03 20:08:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "cinder-quobyte-3adb43b5-5557-41c3-a9e5-fbe0e3577595" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-3adb43b5-5557-41c3-a9e5-fbe0e3577595" acquired by "delete_volume" :: waited 0.081s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:33 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f1df1c-cf7b-45b8-818c-9676b1473b59]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:34 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 Sep 03 20:08:34 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Flow 'volume_create_manager' (a632c86c-d199-4d8c-bbfa-7472dd63b8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf7c101-a69b-4b97-9ca6-b67f7238301f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:34 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf7c101-a69b-4b97-9ca6-b67f7238301f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-195062072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386a9e56-d446-434a-b18e-80eb2b237171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42bf98b12da4ef79c7a3f91b558fdd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=45ed1a3d-7a1a-4399-b940-5af29c0c970a,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:34Z,use_quota=True,user_id='f36e30a1918843c89d72c37c5ef95ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37c2c02-3a3a-4def-a1fd-044dc223b7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37c2c02-3a3a-4def-a1fd-044dc223b7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ab72dd-8a17-41f7-bd53-3c69382bf18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595" returned: 0 in 0.691s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:34 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595 Sep 03 20:08:34 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ab72dd-8a17-41f7-bd53-3c69382bf18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '386a9e56-d446-434a-b18e-80eb2b237171', 'volume_name': 'volume-386a9e56-d446-434a-b18e-80eb2b237171', 'volume_size': 2, 'source_volid': '45ed1a3d-7a1a-4399-b940-5af29c0c970a', 'source_volstatus': 'available'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451c96f9-5c08-481c-8b86-227028a0f948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451c96f9-5c08-481c-8b86-227028a0f948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d6a901-f0f6-405b-88fe-89c3227da053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:34 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Volume 386a9e56-d446-434a-b18e-80eb2b237171: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-386a9e56-d446-434a-b18e-80eb2b237171', 'volume_size': 2, 'source_volid': '45ed1a3d-7a1a-4399-b940-5af29c0c970a', 'source_volstatus': 'available'} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:34 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Cloning volume 45ed1a3d-7a1a-4399-b940-5af29c0c970a to volume 386a9e56-d446-434a-b18e-80eb2b237171 Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Creating offline snapshot c82344b7-2356-4f69-a048-fb4673fcef83 of volume 45ed1a3d-7a1a-4399-b940-5af29c0c970a {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6aa82c-ef18-4e79-afdd-9311770a7e2f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:35 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3adb43b5-5557-41c3-a9e5-fbe0e3577595" returned: 0 in 0.514s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Lock "cinder-quobyte-3adb43b5-5557-41c3-a9e5-fbe0e3577595" released by "delete_volume" :: held 1.372s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:35 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a Sep 03 20:08:35 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Created reservations ['bdaa94fd-0155-439a-80a2-528c06ca519c'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:35 devstack cinder-volume[87582]: WARNING cinder.quota [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2106641720 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2106641720, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Created reservations ['f5fa3f71-d811-41bb-a2d9-98e8d5914741', '5bf7215c-0543-4f07-bf4d-f6dc84aeecd1', '7b932499-dc9f-43c4-ac4d-5e938009ae8a', 'a8d10f39-69a2-49b2-b1fe-7f3045acf8f2'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:35 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:08:35 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:35 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a" returned: 0 in 0.805s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:35 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 1G Sep 03 20:08:35 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:35 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.330s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:35 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:08:35 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f8e5f308-6fc6-4cee-8374-816688a01e04 tempest-GroupSnapshotsTest-2014842171 None] Delete group completed successfully. Sep 03 20:08:36 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 1G" returned: 0 in 0.608s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:36 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 Sep 03 20:08:36 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:08:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:36 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:08:36 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:36 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83" returned: 0 in 0.687s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:36 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 is being set with open permissions: ugo+rw Sep 03 20:08:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:37 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 Sep 03 20:08:37 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:37 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.448s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:08:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:08:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 28 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:08:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:08:37 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83" returned: 0 in 0.620s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:37 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.info Sep 03 20:08:37 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "cinder-2d2b8835-f3e6-4aa0-8f83-62163f27c923-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Lock "cinder-2d2b8835-f3e6-4aa0-8f83-62163f27c923-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:38 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.info" returned: 0 in 0.431s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:38 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.info is being set with open permissions: ugo+rw Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:38 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.info Sep 03 20:08:38 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "cinder-quobyte-2d2b8835-f3e6-4aa0-8f83-62163f27c923" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Lock "cinder-quobyte-2d2b8835-f3e6-4aa0-8f83-62163f27c923" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25c282e-41f7-41c4-89d2-dc50164ad3ac]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:38 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923 Sep 03 20:08:38 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:38 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.info" returned: 0 in 0.341s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Acquiring lock "cinder-quobyte-386a9e56-d446-434a-b18e-80eb2b237171" by "_copy_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Lock "cinder-quobyte-386a9e56-d446-434a-b18e-80eb2b237171" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] snapshot: c82344b7-2356-4f69-a048-fb4673fcef83, volume: 386a9e56-d446-434a-b18e-80eb2b237171, {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4226ee4b-7d48-4563-b16a-ca5d14907a91]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:38 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923" returned: 0 in 0.514s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:38 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 Sep 03 20:08:38 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:38 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923 Sep 03 20:08:38 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:38 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83" returned: 0 in 0.452s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb34bcfc-9bd3-43e8-9607-c524458a0630]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:39 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2d2b8835-f3e6-4aa0-8f83-62163f27c923" returned: 0 in 0.336s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Lock "cinder-quobyte-2d2b8835-f3e6-4aa0-8f83-62163f27c923" released by "delete_volume" :: held 0.905s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Created reservations ['1555bf79-ffde-470d-8bb7-127300c3cf15', '143d39ce-6c34-44a4-b340-3d94f317ba92', 'e9e49b4a-0c71-483d-807e-2cc550579f96', '3850e11c-d649-40b0-9118-fadbab90e227'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:39 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a Sep 03 20:08:39 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:39 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:08:39 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:39 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:39 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a" returned: 0 in 0.570s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Creating direct copy from snapshot {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG cinder.utils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Path /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171 not found in is_blk_device check {{(pid=87582) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.344s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:08:39 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Deleted volume successfully. Sep 03 20:08:39 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171 Sep 03 20:08:39 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5d3cda00-31e4-481e-97f9-3c062c8cc014 tempest-AttachVolumeTestJSON-136447603 None] Lock "cinder-2d2b8835-f3e6-4aa0-8f83-62163f27c923-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "cinder-0c742e68-b93c-420f-aaef-3c0334022b33-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Lock "cinder-0c742e68-b93c-420f-aaef-3c0334022b33-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "cinder-quobyte-0c742e68-b93c-420f-aaef-3c0334022b33" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Lock "cinder-quobyte-0c742e68-b93c-420f-aaef-3c0334022b33" acquired by "delete_volume" :: waited 0.048s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:41 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3ad652-11d1-4dfd-a3ea-ea24d1c62f08]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c742e68-b93c-420f-aaef-3c0334022b33 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:41 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c742e68-b93c-420f-aaef-3c0334022b33 Sep 03 20:08:41 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:42 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c742e68-b93c-420f-aaef-3c0334022b33" returned: 0 in 1.346s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c742e68-b93c-420f-aaef-3c0334022b33 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:42 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c742e68-b93c-420f-aaef-3c0334022b33 Sep 03 20:08:42 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:43 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c742e68-b93c-420f-aaef-3c0334022b33" returned: 0 in 0.877s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Lock "cinder-quobyte-0c742e68-b93c-420f-aaef-3c0334022b33" released by "delete_volume" :: held 2.373s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:43 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Created reservations ['024f719a-7844-48e4-86f2-afa53713de77', '03db4b3e-570b-43e0-a7e4-1d6f3427e9ce', '4729b4fa-f411-4018-9663-3beeeb05e853', 'c446cdb3-aaed-49b2-a27c-8036e1cbacac'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:43 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:08:43 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:44 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.872s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:44 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:08:44 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Deleted volume successfully. Sep 03 20:08:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2cfbce1d-cb6b-4f97-9dd1-042ab702895a tempest-AttachVolumeTestJSON-136447603 None] Lock "cinder-0c742e68-b93c-420f-aaef-3c0334022b33-delete_volume" released by "delete_volume" :: held 4.054s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "cinder-b29a2991-3f49-4800-a2ab-3df76e28d386-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Lock "cinder-b29a2991-3f49-4800-a2ab-3df76e28d386-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "cinder-quobyte-b29a2991-3f49-4800-a2ab-3df76e28d386" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Lock "cinder-quobyte-b29a2991-3f49-4800-a2ab-3df76e28d386" acquired by "delete_volume" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:45 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed01906-38af-45f8-aac7-4a9300d29cfe]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b29a2991-3f49-4800-a2ab-3df76e28d386 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:46 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b29a2991-3f49-4800-a2ab-3df76e28d386 Sep 03 20:08:46 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:46 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171" returned: 0 in 7.314s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:46 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a, size 1024.00 MB, duration 7.32 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:08:46 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Converted 1024.00 MB image at 139.97 MB/s Sep 03 20:08:46 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171 is being set with open permissions: ugo+rw Sep 03 20:08:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:46 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b29a2991-3f49-4800-a2ab-3df76e28d386" returned: 0 in 1.272s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b29a2991-3f49-4800-a2ab-3df76e28d386 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:46 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171 Sep 03 20:08:46 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:46 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b29a2991-3f49-4800-a2ab-3df76e28d386 Sep 03 20:08:46 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:47 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171" returned: 0 in 0.389s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Lock "cinder-quobyte-386a9e56-d446-434a-b18e-80eb2b237171" released by "_copy_volume_from_snapshot" :: held 8.851s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Acquiring lock "cinder-quobyte-c82344b7-2356-4f69-a048-fb4673fcef83" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Lock "cinder-quobyte-c82344b7-2356-4f69-a048-fb4673fcef83" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Deleting offline snapshot c82344b7-2356-4f69-a048-fb4673fcef83 of volume 45ed1a3d-7a1a-4399-b940-5af29c0c970a {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] snapshot_file for this snap is: volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:08:47 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b29a2991-3f49-4800-a2ab-3df76e28d386" returned: 0 in 0.497s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1b7ee9-127d-459d-a1e0-006ef87f3f08]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Lock "cinder-quobyte-b29a2991-3f49-4800-a2ab-3df76e28d386" released by "delete_volume" :: held 1.940s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Created reservations ['5e55c7b4-27c4-411b-a884-9f1329b2a9a7', '467e1035-7b1c-47fb-828d-97d5e657648e', '11788c51-ca57-457c-9ca0-73749396a53c', '193555f7-6296-4a51-91e9-95dbf97127ef'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:47 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 Sep 03 20:08:47 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:47 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:08:47 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:48 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.351s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:48 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:08:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Deleted volume successfully. Sep 03 20:08:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f5aac78d-f320-4c34-8b31-43a268e2382c tempest-AttachVolumeTestJSON-136447603 None] Lock "cinder-b29a2991-3f49-4800-a2ab-3df76e28d386-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:48 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83" returned: 0 in 0.732s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:08:48 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5cd576-fa3e-4770-93bf-6e3a850cc15d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:48 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a Sep 03 20:08:48 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:48 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:08:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Flow 'volume_create_manager' (12bdcb25-3b3d-41e2-b94d-d2fdb1d9b202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde381b0-ff69-4fd5-92f5-5b297e0f83f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde381b0-ff69-4fd5-92f5-5b297e0f83f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-419894590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fedcc42-4d1b-4d13-ada7-c7069d317776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7ebc1e2e36473289853de31a2294fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:49Z,use_quota=True,user_id='932cf0f8ca6b4b8a823f14eb5a80b8e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28a65cb-1cc8-4ac4-8df8-d60836506b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28a65cb-1cc8-4ac4-8df8-d60836506b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53de2263-1488-482b-b040-86ce1a885df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53de2263-1488-482b-b040-86ce1a885df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fedcc42-4d1b-4d13-ada7-c7069d317776', 'volume_name': 'volume-3fedcc42-4d1b-4d13-ada7-c7069d317776', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:49 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d127c08c-6eee-46d6-847d-286b7280ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d127c08c-6eee-46d6-847d-286b7280ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab52f7fb-65e9-4ceb-952e-432c8509162f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:49 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Volume 3fedcc42-4d1b-4d13-ada7-c7069d317776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fedcc42-4d1b-4d13-ada7-c7069d317776', 'volume_size': 1} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a" returned: 0 in 0.817s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:49 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 Sep 03 20:08:49 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:49 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83" returned: 0 in 0.510s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:49 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83 Sep 03 20:08:49 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:49 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a.c82344b7-2356-4f69-a048-fb4673fcef83" returned: 0 in 0.310s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Lock "cinder-quobyte-c82344b7-2356-4f69-a048-fb4673fcef83" released by "_delete_snapshot" :: held 2.541s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.294s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-419894590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fedcc42-4d1b-4d13-ada7-c7069d317776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7ebc1e2e36473289853de31a2294fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:49Z,use_quota=True,user_id='932cf0f8ca6b4b8a823f14eb5a80b8e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Creating volume 3fedcc42-4d1b-4d13-ada7-c7069d317776 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:08:49 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:08:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3fedcc42-4d1b-4d13-ada7-c7069d317776 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d6a901-f0f6-405b-88fe-89c3227da053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-386a9e56-d446-434a-b18e-80eb2b237171', 'volume_size': 2, 'source_volid': '45ed1a3d-7a1a-4399-b940-5af29c0c970a', 'source_volstatus': 'available'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:50 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3fedcc42-4d1b-4d13-ada7-c7069d317776 1073741824 Sep 03 20:08:50 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df43ed8-700c-4c25-9105-120e0180a63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:50 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Volume volume-386a9e56-d446-434a-b18e-80eb2b237171 (386a9e56-d446-434a-b18e-80eb2b237171): created successfully Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df43ed8-700c-4c25-9105-120e0180a63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Flow 'volume_create_manager' (a632c86c-d199-4d8c-bbfa-7472dd63b8c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-41091aa1-9fd3-419f-9724-289ce260fe65 tempest-VolumesCloneTest-1845392326 None] Created volume successfully. Sep 03 20:08:50 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3fedcc42-4d1b-4d13-ada7-c7069d317776 1073741824" returned: 0 in 0.600s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3fedcc42-4d1b-4d13-ada7-c7069d317776 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Acquiring lock "cinder-386a9e56-d446-434a-b18e-80eb2b237171-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:50 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3fedcc42-4d1b-4d13-ada7-c7069d317776 Sep 03 20:08:50 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Lock "cinder-386a9e56-d446-434a-b18e-80eb2b237171-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Acquiring lock "cinder-quobyte-386a9e56-d446-434a-b18e-80eb2b237171" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Lock "cinder-quobyte-386a9e56-d446-434a-b18e-80eb2b237171" acquired by "delete_volume" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cdd5a0-44ee-4dc1-b7e7-1fc62c78930a]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:50 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171 Sep 03 20:08:50 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:50 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3fedcc42-4d1b-4d13-ada7-c7069d317776" returned: 0 in 0.287s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab52f7fb-65e9-4ceb-952e-432c8509162f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fedcc42-4d1b-4d13-ada7-c7069d317776', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d959f52e-d26d-45be-bf86-57f0373e85f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:50 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Volume volume-3fedcc42-4d1b-4d13-ada7-c7069d317776 (3fedcc42-4d1b-4d13-ada7-c7069d317776): created successfully Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d959f52e-d26d-45be-bf86-57f0373e85f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Flow 'volume_create_manager' (12bdcb25-3b3d-41e2-b94d-d2fdb1d9b202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d0edc849-d20f-4ea7-9567-4111332fbb64 tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Created volume successfully. Sep 03 20:08:51 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171" returned: 0 in 0.379s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:51 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171 Sep 03 20:08:51 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:51 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-386a9e56-d446-434a-b18e-80eb2b237171" returned: 0 in 0.304s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Lock "cinder-quobyte-386a9e56-d446-434a-b18e-80eb2b237171" released by "delete_volume" :: held 0.735s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Created reservations ['d2c134a9-3df8-4000-85bf-4196177aaf68', '5c564ada-509c-491e-8187-282f6b329261', 'e688542e-0207-40e4-a3d6-877a66ac00e7', '729a5a18-77e9-46af-8692-33e4a7267d17'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:51 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:08:51 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:51 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.268s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:08:51 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Deleted volume successfully. Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Acquiring lock "cinder-45ed1a3d-7a1a-4399-b940-5af29c0c970a-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Lock "cinder-45ed1a3d-7a1a-4399-b940-5af29c0c970a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d586f9cd-30c8-4ba0-9888-77420f128bb6 tempest-VolumesCloneTest-1845392326 None] Lock "cinder-386a9e56-d446-434a-b18e-80eb2b237171-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Acquiring lock "cinder-quobyte-45ed1a3d-7a1a-4399-b940-5af29c0c970a" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Lock "cinder-quobyte-45ed1a3d-7a1a-4399-b940-5af29c0c970a" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[723dbf42-4aa5-428c-8370-529fd4be6c8a]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:52 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a Sep 03 20:08:52 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:52 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a" returned: 0 in 0.408s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:52 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a Sep 03 20:08:52 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:52 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45ed1a3d-7a1a-4399-b940-5af29c0c970a" returned: 0 in 0.343s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Lock "cinder-quobyte-45ed1a3d-7a1a-4399-b940-5af29c0c970a" released by "delete_volume" :: held 0.816s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Created reservations ['90ae36fc-2c9f-48c8-a200-32119ef641a2', '6796d464-e194-4cef-b0ac-2aaac9954aac', 'd72a2043-34b9-4935-8478-d26bf829b05f', 'f1d51305-b5d5-45b6-9c4a-29f390b1059a'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:53 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:08:53 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Acquiring lock "cinder-3fedcc42-4d1b-4d13-ada7-c7069d317776-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Lock "cinder-3fedcc42-4d1b-4d13-ada7-c7069d317776-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:53 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.363s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:53 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:08:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Acquiring lock "cinder-quobyte-3fedcc42-4d1b-4d13-ada7-c7069d317776" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:08:53 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Deleted volume successfully. Sep 03 20:08:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Lock "cinder-quobyte-3fedcc42-4d1b-4d13-ada7-c7069d317776" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:08:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3db66f48-e7b8-4ae7-bf94-7c129866beed tempest-VolumesCloneTest-1845392326 None] Lock "cinder-45ed1a3d-7a1a-4399-b940-5af29c0c970a-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:53 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71e4f5e-a24d-491b-b9b5-2493e0f1aa91]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3fedcc42-4d1b-4d13-ada7-c7069d317776 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:53 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3fedcc42-4d1b-4d13-ada7-c7069d317776 Sep 03 20:08:53 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:53 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3fedcc42-4d1b-4d13-ada7-c7069d317776" returned: 0 in 0.431s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3fedcc42-4d1b-4d13-ada7-c7069d317776 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:53 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3fedcc42-4d1b-4d13-ada7-c7069d317776 Sep 03 20:08:53 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:54 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3fedcc42-4d1b-4d13-ada7-c7069d317776" returned: 0 in 0.309s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Lock "cinder-quobyte-3fedcc42-4d1b-4d13-ada7-c7069d317776" released by "delete_volume" :: held 0.796s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:54 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Created reservations ['0aa5b1c4-f598-4b1a-beb8-edb5e9daf483', '34e19e82-937e-4619-a5f1-49cdcd78f398', '2f89d48c-347a-4288-9993-895cc67a0151', 'a5f8c22f-de25-4247-a7f7-2e2c8b93f3e8'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:08:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:54 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:08:54 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:54 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.307s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:54 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:08:54 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Deleted volume successfully. Sep 03 20:08:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ae784d4c-a082-409a-bce2-42381996681a tempest-VolumeQuotasNegativeTestJSON-1984391371 None] Lock "cinder-3fedcc42-4d1b-4d13-ada7-c7069d317776-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Flow 'volume_create_manager' (66d3f4d1-5355-41ab-aeb2-5f635c7338d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef1d012-9251-4c28-9f59-2a6cbbb43d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef1d012-9251-4c28-9f59-2a6cbbb43d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1407933148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8ae6f5-b75c-45ba-9a18-2724267e8de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0127b7f44cef4738896fb07c12457490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:58Z,use_quota=True,user_id='555bc62a97f045329a201e1fcc6f7ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a23778-0b35-4da0-99f9-9939b409b4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a23778-0b35-4da0-99f9-9939b409b4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b13cdd-6468-4435-9e10-bb877c69a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.image.glance [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Creating Keystone auth plugin from conf {{(pid=87582) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Flow 'volume_create_manager' (229b1e78-d25f-4cbb-b5c8-dcd0eb938e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8afa24e8-d26f-4421-8903-5bd281db4d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8afa24e8-d26f-4421-8903-5bd281db4d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-214314659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8913d31-5523-4b2f-b415-f0fdc8caa1e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='936548e949844e269a9287a76a7bd5d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:59Z,use_quota=True,user_id='6632022d329e44d9af71ff6e88705c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d787a73b-fa69-4942-ba90-3de5a5e531a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d787a73b-fa69-4942-ba90-3de5a5e531a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8054fe-e527-4ed7-9577-aa5b899efcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8054fe-e527-4ed7-9577-aa5b899efcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8913d31-5523-4b2f-b415-f0fdc8caa1e9', 'volume_name': 'volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24aa5040-6980-4f34-bb04-0a2da2f42db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24aa5040-6980-4f34-bb04-0a2da2f42db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6c651d-1b9c-4ce3-aacc-2585317218a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:58 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Volume b8913d31-5523-4b2f-b415-f0fdc8caa1e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9', 'volume_size': 1} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-214314659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8913d31-5523-4b2f-b415-f0fdc8caa1e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='936548e949844e269a9287a76a7bd5d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:59Z,use_quota=True,user_id='6632022d329e44d9af71ff6e88705c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Creating volume b8913d31-5523-4b2f-b415-f0fdc8caa1e9 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:08:58 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:58 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9 1073741824 Sep 03 20:08:58 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b13cdd-6468-4435-9e10-bb877c69a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b8ae6f5-b75c-45ba-9a18-2724267e8de9', 'volume_name': 'volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765f3e5e-1dc3-44fa-b63c-27fc9a26709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765f3e5e-1dc3-44fa-b63c-27fc9a26709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28070c5-fd26-42ab-83a2-550fbf57c298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:58 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Volume 8b8ae6f5-b75c-45ba-9a18-2724267e8de9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 20:08:58 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Trying to clone 8b8ae6f5-b75c-45ba-9a18-2724267e8de9 from image 2f677e69-c223-4c71-b630-2245f346f65e at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]). {{(pid=87582) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 20:08:59 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Image download 20.69 MB at 20.69 MB/s Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f33480-12d6-434e-865f-0a6919723e89]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:59 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9 1073741824" returned: 0 in 0.604s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:59 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD Sep 03 20:08:59 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:59 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9 Sep 03 20:08:59 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:08:59 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Temporary image 2f677e69-c223-4c71-b630-2245f346f65e is fetched for user 555bc62a97f045329a201e1fcc6f7ecc. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8a6bc4-05e8-4a16-b1c6-bc3b8511c6d7]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:08:59 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9" returned: 0 in 0.380s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6c651d-1b9c-4ce3-aacc-2585317218a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d98dba-8aa2-4199-a4ae-879b76ce3ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:08:59 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Volume volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9 (b8913d31-5523-4b2f-b415-f0fdc8caa1e9): created successfully Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d98dba-8aa2-4199-a4ae-879b76ce3ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:08:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Flow 'volume_create_manager' (229b1e78-d25f-4cbb-b5c8-dcd0eb938e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:08:59 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-3bf93e8f-fdf2-486e-9845-9d5ebae3350d req-1d8606ef-d38e-4658-8a6b-d94dc8873ac0 tempest-VolumesGetTestJSON-958704089 None] Created volume successfully. Sep 03 20:08:59 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD Sep 03 20:08:59 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:00 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1407933148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8ae6f5-b75c-45ba-9a18-2724267e8de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0127b7f44cef4738896fb07c12457490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:08:58Z,use_quota=True,user_id='555bc62a97f045329a201e1fcc6f7ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Creating volume 8b8ae6f5-b75c-45ba-9a18-2724267e8de9 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:09:00 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:00 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 1073741824 Sep 03 20:09:00 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:00 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 1073741824" returned: 0 in 0.453s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:00 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 Sep 03 20:09:00 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:01 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9" returned: 0 in 0.284s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:UPDATE=158,cinder:INSERT=40,cinder:SELECT=166,cinder:DELETE=10 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Attempting download of 2f677e69-c223-4c71-b630-2245f346f65e ((None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}])) to volume 8b8ae6f5-b75c-45ba-9a18-2724267e8de9. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce42bd6-e2b6-43e9-807a-76829d031e92]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_icxi9zpp {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:01 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_icxi9zpp Sep 03 20:09:01 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Acquiring lock "cinder-b8913d31-5523-4b2f-b415-f0fdc8caa1e9-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Lock "cinder-b8913d31-5523-4b2f-b415-f0fdc8caa1e9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Acquiring lock "cinder-quobyte-b8913d31-5523-4b2f-b415-f0fdc8caa1e9" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Lock "cinder-quobyte-b8913d31-5523-4b2f-b415-f0fdc8caa1e9" acquired by "delete_volume" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f362be-9d52-4f7d-999d-0f63625ec04d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:01 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_icxi9zpp" returned: 0 in 0.421s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_icxi9zpp {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:01 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9 Sep 03 20:09:01 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:01 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_icxi9zpp Sep 03 20:09:01 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:01 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_icxi9zpp" returned: 1 in 0.354s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_icxi9zpp' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[72994dc5-7504-4fe4-9d0f-c9ce07619347]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:01 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9" returned: 0 in 0.408s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:01 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9 Sep 03 20:09:01 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:02 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD Sep 03 20:09:02 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:02 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b8913d31-5523-4b2f-b415-f0fdc8caa1e9" returned: 0 in 0.299s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Lock "cinder-quobyte-b8913d31-5523-4b2f-b415-f0fdc8caa1e9" released by "delete_volume" :: held 0.761s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:02 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] 2f677e69-c223-4c71-b630-2245f346f65e was qcow2, converting to qcow2 {{(pid=87582) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:02 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 Sep 03 20:09:02 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG cinder.quota [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Created reservations ['45d5ce86-c1fa-4e4d-9fe0-ddf568a9db0a', '89d0f10e-6538-4c05-8833-93543e8853e4', 'e2925595-4e62-44b5-a23e-3805c455a633', 'f47ca99b-b967-4637-8191-28c78547dab4'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:02 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:02 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:02 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.319s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG cinder.manager [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:02 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Deleted volume successfully. Sep 03 20:09:02 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-8e5d1669-cf6d-4fc8-b959-8481d49d5cfe req-e0f2cb59-2a54-4c53-a64a-dc40cd923165 tempest-VolumesGetTestJSON-958704089 None] Lock "cinder-b8913d31-5523-4b2f-b415-f0fdc8caa1e9-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:04 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9" returned: 0 in 2.289s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:04 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_l01boin4devstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:09:04 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Converted 112.00 MB image at 48.90 MB/s Sep 03 20:09:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:04 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 1G Sep 03 20:09:04 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:04 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 1G" returned: 0 in 0.376s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:04 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Downloaded image 2f677e69-c223-4c71-b630-2245f346f65e ((None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}])) to volume 8b8ae6f5-b75c-45ba-9a18-2724267e8de9 successfully. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 20:09:04 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Temporary image 2f677e69-c223-4c71-b630-2245f346f65e for user 555bc62a97f045329a201e1fcc6f7ecc is deleted. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 20:09:04 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Marking volume 8b8ae6f5-b75c-45ba-9a18-2724267e8de9 as bootable. {{(pid=87582) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 20:09:05 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Copying metadata from image 2f677e69-c223-4c71-b630-2245f346f65e to 8b8ae6f5-b75c-45ba-9a18-2724267e8de9. {{(pid=87582) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 20:09:05 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Creating volume glance metadata for volume 8b8ae6f5-b75c-45ba-9a18-2724267e8de9 backed by image 2f677e69-c223-4c71-b630-2245f346f65e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87582) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 20:09:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28070c5-fd26-42ab-83a2-550fbf57c298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0bfe614-10d1-47ee-b0b5-ff700650a4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:05 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Volume volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 (8b8ae6f5-b75c-45ba-9a18-2724267e8de9): created successfully Sep 03 20:09:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0bfe614-10d1-47ee-b0b5-ff700650a4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Flow 'volume_create_manager' (66d3f4d1-5355-41ab-aeb2-5f635c7338d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:05 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9f733db1-975b-4fda-a3bc-7f68a7f21c7b tempest-VolumesExtendTest-1512740149 None] Created volume successfully. Sep 03 20:09:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fa16c67a-9581-4d45-9979-3b59e8b04bc7 tempest-VolumesExtendTest-1512740149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fa16c67a-9581-4d45-9979-3b59e8b04bc7 tempest-VolumesExtendTest-1512740149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:05 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[05da79ee-070b-4fbe-96fc-728382ba2429]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa16c67a-9581-4d45-9979-3b59e8b04bc7 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:05 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 Sep 03 20:09:05 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:06 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa16c67a-9581-4d45-9979-3b59e8b04bc7 tempest-VolumesExtendTest-1512740149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9" returned: 0 in 0.409s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa16c67a-9581-4d45-9979-3b59e8b04bc7 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 2G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa16c67a-9581-4d45-9979-3b59e8b04bc7 tempest-VolumesExtendTest-1512740149 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 2G" returned: 0 in 0.126s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fa16c67a-9581-4d45-9979-3b59e8b04bc7 tempest-VolumesExtendTest-1512740149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.560s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:06 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-fa16c67a-9581-4d45-9979-3b59e8b04bc7 tempest-VolumesExtendTest-1512740149 None] Extend volume completed successfully. Sep 03 20:09:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Acquiring lock "cinder-8b8ae6f5-b75c-45ba-9a18-2724267e8de9-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Lock "cinder-8b8ae6f5-b75c-45ba-9a18-2724267e8de9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Acquiring lock "cinder-quobyte-8b8ae6f5-b75c-45ba-9a18-2724267e8de9" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Lock "cinder-quobyte-8b8ae6f5-b75c-45ba-9a18-2724267e8de9" acquired by "delete_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7598ea-1c90-4b28-9671-ebf8badace78]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:07 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 Sep 03 20:09:07 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Flow 'volume_create_manager' (16dcaf81-e8c8-4573-87fa-ba1c5328cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4946d86-f687-4775-a8b9-529b489f8fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4946d86-f687-4775-a8b9-529b489f8fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1057384987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17606b0c-a41c-46d9-8876-212ea3dab7db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8a5cbae9d074d2584b6dd6037278816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:07Z,use_quota=True,user_id='581745e3ca4440bf9df4a763a6a87311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bdaf5e-10ef-4970-a462-8ce6b6786c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bdaf5e-10ef-4970-a462-8ce6b6786c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de87841e-df88-4497-a89e-7ba79e2059bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de87841e-df88-4497-a89e-7ba79e2059bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17606b0c-a41c-46d9-8876-212ea3dab7db', 'volume_name': 'volume-17606b0c-a41c-46d9-8876-212ea3dab7db', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6051735-4bc9-46fd-ba8a-e3309071d024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6051735-4bc9-46fd-ba8a-e3309071d024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630ff5d1-e74a-4730-97cf-ac3cbd437399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:07 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Volume 17606b0c-a41c-46d9-8876-212ea3dab7db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17606b0c-a41c-46d9-8876-212ea3dab7db', 'volume_size': 1} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1057384987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17606b0c-a41c-46d9-8876-212ea3dab7db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8a5cbae9d074d2584b6dd6037278816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:07Z,use_quota=True,user_id='581745e3ca4440bf9df4a763a6a87311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Creating volume 17606b0c-a41c-46d9-8876-212ea3dab7db {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:09:07 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-17606b0c-a41c-46d9-8876-212ea3dab7db 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:07 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-17606b0c-a41c-46d9-8876-212ea3dab7db 1073741824 Sep 03 20:09:07 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:07 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9" returned: 0 in 0.413s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:07 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9 Sep 03 20:09:07 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:07 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8b8ae6f5-b75c-45ba-9a18-2724267e8de9" returned: 0 in 0.275s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Lock "cinder-quobyte-8b8ae6f5-b75c-45ba-9a18-2724267e8de9" released by "delete_volume" :: held 0.739s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:UPDATE=165,cinder:SELECT=141,cinder:DELETE=9,cinder:INSERT=49 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:09:07 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-17606b0c-a41c-46d9-8876-212ea3dab7db 1073741824" returned: 0 in 0.507s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Created reservations ['568031d2-f940-42f1-bc99-86ec92e8a133', '7727a922-ddbc-422b-8411-536ee446bd06', 'dad6feb3-6f42-402c-b338-0adb81cdaae2', '1be2c345-5b3c-46b7-8fac-5772675bc60d'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-17606b0c-a41c-46d9-8876-212ea3dab7db {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:07 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-17606b0c-a41c-46d9-8876-212ea3dab7db Sep 03 20:09:07 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:07 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:07 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:08 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-17606b0c-a41c-46d9-8876-212ea3dab7db" returned: 0 in 0.314s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630ff5d1-e74a-4730-97cf-ac3cbd437399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17606b0c-a41c-46d9-8876-212ea3dab7db', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8a5ad9-8162-46d9-859a-feb69ca8d3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:08 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Volume volume-17606b0c-a41c-46d9-8876-212ea3dab7db (17606b0c-a41c-46d9-8876-212ea3dab7db): created successfully Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8a5ad9-8162-46d9-859a-feb69ca8d3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Flow 'volume_create_manager' (16dcaf81-e8c8-4573-87fa-ba1c5328cf97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-37dfeb14-3e55-4f78-ae0f-3bd6b9e5fc04 tempest-VolumesTestJSON-796964361 None] Created volume successfully. Sep 03 20:09:08 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.313s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Deleted volume successfully. Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-00c30bdf-8043-4861-b673-8312855e0850 tempest-VolumesExtendTest-1512740149 None] Lock "cinder-8b8ae6f5-b75c-45ba-9a18-2724267e8de9-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Flow 'volume_create_manager' (ac072d99-5bfa-414f-add4-672892b532d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efed7c42-bd27-42d9-936e-73edd42f0cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efed7c42-bd27-42d9-936e-73edd42f0cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1330647178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8188b8-c4ad-4a88-9232-960e26aa37fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0127b7f44cef4738896fb07c12457490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:09Z,use_quota=True,user_id='555bc62a97f045329a201e1fcc6f7ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ad7b19-d6f7-4b24-91ad-1eab40dc00d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ad7b19-d6f7-4b24-91ad-1eab40dc00d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66396d7-1bc7-4d7e-977a-8029d65c8c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66396d7-1bc7-4d7e-977a-8029d65c8c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d8188b8-c4ad-4a88-9232-960e26aa37fb', 'volume_name': 'volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9c1463-02c1-471e-9203-5bde7d2e3bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9c1463-02c1-471e-9203-5bde7d2e3bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e01c09-bb49-4743-9104-9c0f0bfca60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:08 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Volume 7d8188b8-c4ad-4a88-9232-960e26aa37fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb', 'volume_size': 1} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1330647178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8188b8-c4ad-4a88-9232-960e26aa37fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0127b7f44cef4738896fb07c12457490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:09Z,use_quota=True,user_id='555bc62a97f045329a201e1fcc6f7ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Creating volume 7d8188b8-c4ad-4a88-9232-960e26aa37fb {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:09:08 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:09:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:08 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb 1073741824 Sep 03 20:09:08 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:09 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb 1073741824" returned: 0 in 0.444s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:09 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb Sep 03 20:09:09 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:09 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb" returned: 0 in 0.290s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e01c09-bb49-4743-9104-9c0f0bfca60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012942c5-2f8e-4876-9d18-a129748dfed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:09 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Volume volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb (7d8188b8-c4ad-4a88-9232-960e26aa37fb): created successfully Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012942c5-2f8e-4876-9d18-a129748dfed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Flow 'volume_create_manager' (ac072d99-5bfa-414f-add4-672892b532d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:09 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8528baa6-a998-4938-8f4e-13c542ff1ba2 tempest-VolumesExtendTest-1512740149 None] Created volume successfully. Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Flow 'volume_create_manager' (b3e3e414-32fe-4283-ab99-fd627b654953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8dd665-c1e0-4c79-a08d-1ae00cccefc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8dd665-c1e0-4c79-a08d-1ae00cccefc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-353170250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357903a5-8464-4838-9f8f-c9b4cac3aab9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8a5cbae9d074d2584b6dd6037278816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:10Z,use_quota=True,user_id='581745e3ca4440bf9df4a763a6a87311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c240ee-8d8d-4996-add0-73e850190289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c240ee-8d8d-4996-add0-73e850190289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29634621-2a5e-41fc-8370-0a70a52f70d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29634621-2a5e-41fc-8370-0a70a52f70d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '357903a5-8464-4838-9f8f-c9b4cac3aab9', 'volume_name': 'volume-357903a5-8464-4838-9f8f-c9b4cac3aab9', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da97f2a1-67bf-4fd9-9f3f-5c2f298d2ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da97f2a1-67bf-4fd9-9f3f-5c2f298d2ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0565720-2ce5-4247-b928-c9cba27c7176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:09 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Volume 357903a5-8464-4838-9f8f-c9b4cac3aab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-357903a5-8464-4838-9f8f-c9b4cac3aab9', 'volume_size': 1} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-353170250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357903a5-8464-4838-9f8f-c9b4cac3aab9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8a5cbae9d074d2584b6dd6037278816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:10Z,use_quota=True,user_id='581745e3ca4440bf9df4a763a6a87311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Creating volume 357903a5-8464-4838-9f8f-c9b4cac3aab9 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:09:09 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:09:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-357903a5-8464-4838-9f8f-c9b4cac3aab9 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:10 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-357903a5-8464-4838-9f8f-c9b4cac3aab9 1073741824 Sep 03 20:09:10 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:10 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-357903a5-8464-4838-9f8f-c9b4cac3aab9 1073741824" returned: 0 in 0.491s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-357903a5-8464-4838-9f8f-c9b4cac3aab9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:10 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-357903a5-8464-4838-9f8f-c9b4cac3aab9 Sep 03 20:09:10 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:10 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-357903a5-8464-4838-9f8f-c9b4cac3aab9" returned: 0 in 0.273s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0565720-2ce5-4247-b928-c9cba27c7176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-357903a5-8464-4838-9f8f-c9b4cac3aab9', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b668ec-b450-4627-b0df-3b295b10d504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:10 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Volume volume-357903a5-8464-4838-9f8f-c9b4cac3aab9 (357903a5-8464-4838-9f8f-c9b4cac3aab9): created successfully Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b668ec-b450-4627-b0df-3b295b10d504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Flow 'volume_create_manager' (b3e3e414-32fe-4283-ab99-fd627b654953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:10 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8d83d086-483d-4b08-a0cd-7687dfec3f05 tempest-VolumesTestJSON-796964361 None] Created volume successfully. Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] Creating offline snapshot cdd948bc-3c24-4375-9062-dbfb9fc50988 of volume 7d8188b8-c4ad-4a88-9232-960e26aa37fb {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38fa178-6a73-40b4-867b-c071e678af16]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:11 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb Sep 03 20:09:11 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:11 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb" returned: 0 in 0.397s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:11 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 1G Sep 03 20:09:11 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:11 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 1G" returned: 0 in 0.446s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:11 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 Sep 03 20:09:11 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:12 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988" returned: 0 in 0.306s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:12 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 is being set with open permissions: ugo+rw Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:12 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 Sep 03 20:09:12 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:12 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988" returned: 0 in 0.303s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:12 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.info Sep 03 20:09:12 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Flow 'volume_create_manager' (509cab68-cf34-4a2d-972b-57940db836b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedfd3f4-547d-49cd-91dd-c43d25f49c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedfd3f4-547d-49cd-91dd-c43d25f49c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-219018329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197081ed-97b2-4373-a25d-4190bc1d254a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b976a0ffcb57475aa5f587bdcb44134f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:12Z,use_quota=True,user_id='115bb8265c9b46809c62516e94d5b869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed7e3512-5653-4418-b6e3-406e610a75d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed7e3512-5653-4418-b6e3-406e610a75d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbbd77a-2da8-40b3-acfe-f58ddfd90baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbbd77a-2da8-40b3-acfe-f58ddfd90baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197081ed-97b2-4373-a25d-4190bc1d254a', 'volume_name': 'volume-197081ed-97b2-4373-a25d-4190bc1d254a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e112c2-d1f3-4f1d-b7d0-141a37b56bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e112c2-d1f3-4f1d-b7d0-141a37b56bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616679a1-f7a8-4992-b8a0-6be38c0e3746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:12 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Volume 197081ed-97b2-4373-a25d-4190bc1d254a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197081ed-97b2-4373-a25d-4190bc1d254a', 'volume_size': 1} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Flow 'volume_create_manager' (abb1955e-32db-4e2b-94f7-9aaf822cc4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e65819e-e3bf-45da-9b13-d8c65cee7156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e65819e-e3bf-45da-9b13-d8c65cee7156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1075354993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d485f48-2bbd-4854-bb26-2d7deceafd50,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8a5cbae9d074d2584b6dd6037278816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:13Z,use_quota=True,user_id='581745e3ca4440bf9df4a763a6a87311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a006c958-1a2b-4482-91bd-15a247c21ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a006c958-1a2b-4482-91bd-15a247c21ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884709c8-4dac-43b6-abaf-f9a11db184fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884709c8-4dac-43b6-abaf-f9a11db184fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d485f48-2bbd-4854-bb26-2d7deceafd50', 'volume_name': 'volume-1d485f48-2bbd-4854-bb26-2d7deceafd50', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d3906c-89da-49d6-8d9a-4e018e09672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d3906c-89da-49d6-8d9a-4e018e09672e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329a3925-fbe5-41a1-b7a2-5ef0b51c42d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:12 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Volume 1d485f48-2bbd-4854-bb26-2d7deceafd50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d485f48-2bbd-4854-bb26-2d7deceafd50', 'volume_size': 1} Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:12 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.info" returned: 0 in 0.288s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:12 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.info is being set with open permissions: ugo+rw Sep 03 20:09:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:12 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.info Sep 03 20:09:12 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:13 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.info" returned: 0 in 0.241s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-219018329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197081ed-97b2-4373-a25d-4190bc1d254a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b976a0ffcb57475aa5f587bdcb44134f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:12Z,use_quota=True,user_id='115bb8265c9b46809c62516e94d5b869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Creating volume 197081ed-97b2-4373-a25d-4190bc1d254a {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:09:13 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:13 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a 1073741824 Sep 03 20:09:13 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:13 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-078c84ca-6920-407c-b0bc-d9e3567d9057 tempest-VolumesExtendTest-1512740149 None] Create snapshot completed successfully Sep 03 20:09:13 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a 1073741824" returned: 0 in 0.448s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:13 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a Sep 03 20:09:13 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:13 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a" returned: 0 in 0.255s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.025s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1075354993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d485f48-2bbd-4854-bb26-2d7deceafd50,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8a5cbae9d074d2584b6dd6037278816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:13Z,use_quota=True,user_id='581745e3ca4440bf9df4a763a6a87311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Creating volume 1d485f48-2bbd-4854-bb26-2d7deceafd50 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:09:13 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1d485f48-2bbd-4854-bb26-2d7deceafd50 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616679a1-f7a8-4992-b8a0-6be38c0e3746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197081ed-97b2-4373-a25d-4190bc1d254a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccfd2ed-5c56-4776-a414-fa77cd860117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:13 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1d485f48-2bbd-4854-bb26-2d7deceafd50 1073741824 Sep 03 20:09:13 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:13 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Volume volume-197081ed-97b2-4373-a25d-4190bc1d254a (197081ed-97b2-4373-a25d-4190bc1d254a): created successfully Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccfd2ed-5c56-4776-a414-fa77cd860117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Flow 'volume_create_manager' (509cab68-cf34-4a2d-972b-57940db836b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:13 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-428661ac-826c-459f-ab01-43205fa02b2e tempest-VolumesDeleteCascade-998739366 None] Created volume successfully. Sep 03 20:09:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-447d5536-fafc-4cd2-845b-63653cfec244 tempest-VolumesExtendTest-1512740149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:14 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1d485f48-2bbd-4854-bb26-2d7deceafd50 1073741824" returned: 0 in 0.771s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1d485f48-2bbd-4854-bb26-2d7deceafd50 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:14 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1d485f48-2bbd-4854-bb26-2d7deceafd50 Sep 03 20:09:14 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:15 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1d485f48-2bbd-4854-bb26-2d7deceafd50" returned: 0 in 0.390s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-447d5536-fafc-4cd2-845b-63653cfec244 tempest-VolumesExtendTest-1512740149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.704s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329a3925-fbe5-41a1-b7a2-5ef0b51c42d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d485f48-2bbd-4854-bb26-2d7deceafd50', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b94c1da-9c31-48e5-8e0a-36c74e15c7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f175e26e-5630-4f30-b1cb-a143ac8273e2]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-447d5536-fafc-4cd2-845b-63653cfec244 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:15 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Volume volume-1d485f48-2bbd-4854-bb26-2d7deceafd50 (1d485f48-2bbd-4854-bb26-2d7deceafd50): created successfully Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b94c1da-9c31-48e5-8e0a-36c74e15c7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Flow 'volume_create_manager' (abb1955e-32db-4e2b-94f7-9aaf822cc4e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:15 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2fe7bfa6-f737-4c24-92c7-ac9468c20f7b tempest-VolumesTestJSON-796964361 None] Created volume successfully. Sep 03 20:09:15 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb Sep 03 20:09:15 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:15 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-447d5536-fafc-4cd2-845b-63653cfec244 tempest-VolumesExtendTest-1512740149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb" returned: 0 in 0.453s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-447d5536-fafc-4cd2-845b-63653cfec244 tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 2G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-447d5536-fafc-4cd2-845b-63653cfec244 tempest-VolumesExtendTest-1512740149 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 2G" returned: 0 in 0.144s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-447d5536-fafc-4cd2-845b-63653cfec244 tempest-VolumesExtendTest-1512740149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.643s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.752s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] Creating offline snapshot 86efcf72-d7f6-4483-a45b-d34d4faa0445 of volume 197081ed-97b2-4373-a25d-4190bc1d254a {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11f2acd-ab25-4b90-9e89-4185c5ec067b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:15 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-447d5536-fafc-4cd2-845b-63653cfec244 tempest-VolumesExtendTest-1512740149 None] Extend volume completed successfully. Sep 03 20:09:15 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-03db061b-21b7-4c1c-887d-64f09d1d31a6 tempest-ServerActionsTestOtherA-1138108255 None] Terminate volume connection completed successfully. Sep 03 20:09:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-03db061b-21b7-4c1c-887d-64f09d1d31a6 tempest-ServerActionsTestOtherA-1138108255 None] Deleting attachment 82f974b2-97b2-469c-8da9-7516d8d4aae0. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:09:15 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a Sep 03 20:09:15 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "cinder-e633edf6-0068-44bc-9425-ee04cc34090c-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Lock "cinder-e633edf6-0068-44bc-9425-ee04cc34090c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "cinder-quobyte-e633edf6-0068-44bc-9425-ee04cc34090c" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Lock "cinder-quobyte-e633edf6-0068-44bc-9425-ee04cc34090c" acquired by "delete_volume" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f801aec-4e11-4d69-b6ab-d46f2b01240f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:16 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a" returned: 0 in 0.435s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:16 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 1G Sep 03 20:09:16 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:16 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c Sep 03 20:09:16 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:16 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c" returned: 0 in 0.527s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Acquiring lock "cinder-cdd948bc-3c24-4375-9062-dbfb9fc50988-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:16 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c Sep 03 20:09:16 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Lock "cinder-cdd948bc-3c24-4375-9062-dbfb9fc50988-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Acquiring lock "cinder-quobyte-7d8188b8-c4ad-4a88-9232-960e26aa37fb" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Lock "cinder-quobyte-7d8188b8-c4ad-4a88-9232-960e26aa37fb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Acquiring lock "cinder-quobyte-cdd948bc-3c24-4375-9062-dbfb9fc50988" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Lock "cinder-quobyte-cdd948bc-3c24-4375-9062-dbfb9fc50988" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Deleting offline snapshot cdd948bc-3c24-4375-9062-dbfb9fc50988 of volume 7d8188b8-c4ad-4a88-9232-960e26aa37fb {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] snapshot_file for this snap is: volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adcb6bd-9f4c-4fe5-98b4-46b9a64cea87]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:16 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 1G" returned: 0 in 0.663s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197081ed-97b2-4373-a25d-4190bc1d254a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:16 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197081ed-97b2-4373-a25d-4190bc1d254a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 Sep 03 20:09:16 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:17 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 Sep 03 20:09:17 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:17 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e633edf6-0068-44bc-9425-ee04cc34090c" returned: 0 in 0.342s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Lock "cinder-quobyte-e633edf6-0068-44bc-9425-ee04cc34090c" released by "delete_volume" :: held 0.922s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.quota [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Created reservations ['a74dfdfa-4df0-4f6e-ba63-382d1bb9c2c9', '76678d97-8c40-47ca-afe9-48ca24e4b320', 'df7a4a59-81a9-49e9-9f7a-5fa462392b21', '198c3089-5aea-4151-8f7b-3a3bcd5311b4'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Acquiring lock "cinder-1d485f48-2bbd-4854-bb26-2d7deceafd50-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Lock "cinder-1d485f48-2bbd-4854-bb26-2d7deceafd50-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Acquiring lock "cinder-quobyte-1d485f48-2bbd-4854-bb26-2d7deceafd50" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:17 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197081ed-97b2-4373-a25d-4190bc1d254a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445" returned: 0 in 0.372s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:17 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 is being set with open permissions: ugo+rw Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:17 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 Sep 03 20:09:17 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Lock "cinder-quobyte-1d485f48-2bbd-4854-bb26-2d7deceafd50" acquired by "delete_volume" :: waited 0.060s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:17 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:17 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:17 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988" returned: 0 in 0.463s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4659eb-bc43-4547-9ae3-e0b111a41078]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1d485f48-2bbd-4854-bb26-2d7deceafd50 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5817c90f-9c55-46ae-a274-76e2d4cdbd4c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:17 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1d485f48-2bbd-4854-bb26-2d7deceafd50 Sep 03 20:09:17 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:17 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb Sep 03 20:09:17 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:17 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445" returned: 0 in 0.290s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:17 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.284s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.manager [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:17 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Deleted volume successfully. Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-cab1a30e-a319-45ce-9eb5-b8701e511a8f req-d27f938f-1028-4007-b7b4-160775996485 tempest-ServerActionsTestOtherA-1138108255 None] Lock "cinder-e633edf6-0068-44bc-9425-ee04cc34090c-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:17 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.info Sep 03 20:09:17 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:17 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1d485f48-2bbd-4854-bb26-2d7deceafd50" returned: 0 in 0.430s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1d485f48-2bbd-4854-bb26-2d7deceafd50 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:17 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb" returned: 0 in 0.458s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:17 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1d485f48-2bbd-4854-bb26-2d7deceafd50 Sep 03 20:09:17 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "cinder-72081664-b977-457a-a7c9-12b81f297df7-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Lock "cinder-72081664-b977-457a-a7c9-12b81f297df7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:17 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 Sep 03 20:09:17 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "cinder-quobyte-72081664-b977-457a-a7c9-12b81f297df7" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Lock "cinder-quobyte-72081664-b977-457a-a7c9-12b81f297df7" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:17 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d622787-a299-4d20-8436-adc3918e65d6]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-72081664-b977-457a-a7c9-12b81f297df7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.info" returned: 0 in 0.373s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:17 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.info is being set with open permissions: ugo+rw Sep 03 20:09:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:18 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.info Sep 03 20:09:18 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:18 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-72081664-b977-457a-a7c9-12b81f297df7 Sep 03 20:09:18 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:18 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1d485f48-2bbd-4854-bb26-2d7deceafd50" returned: 0 in 0.359s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Lock "cinder-quobyte-1d485f48-2bbd-4854-bb26-2d7deceafd50" released by "delete_volume" :: held 0.850s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Created reservations ['aabe4b7e-5186-4b04-b108-77b1fa1d3e8f', '190b53d6-8463-4ce6-b68b-a7c3e3f8e0e3', '96103f08-0e4a-49d6-9a01-285d42e382a8', 'e7325b35-e88f-4327-870e-9f441ecb95b8'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:18 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988" returned: 0 in 0.501s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:18 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.info" returned: 0 in 0.365s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:18 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988 Sep 03 20:09:18 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.670s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:18 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-72081664-b977-457a-a7c9-12b81f297df7" returned: 0 in 0.420s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-72081664-b977-457a-a7c9-12b81f297df7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:18 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-72081664-b977-457a-a7c9-12b81f297df7 Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:18 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:18 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9cf3e22f-556d-44a5-9cea-3df96bf9cfeb tempest-VolumesDeleteCascade-998739366 None] Create snapshot completed successfully Sep 03 20:09:18 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:18 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:18 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb.cdd948bc-3c24-4375-9062-dbfb9fc50988" returned: 0 in 0.254s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Lock "cinder-quobyte-cdd948bc-3c24-4375-9062-dbfb9fc50988" released by "_delete_snapshot" :: held 1.788s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Lock "cinder-quobyte-7d8188b8-c4ad-4a88-9232-960e26aa37fb" released by "delete_snapshot" :: held 1.821s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:18 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-72081664-b977-457a-a7c9-12b81f297df7" returned: 0 in 0.278s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Lock "cinder-quobyte-72081664-b977-457a-a7c9-12b81f297df7" released by "delete_volume" :: held 0.738s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:18 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.270s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Created reservations ['b202d1f0-cabe-4692-aa82-ee2708857a4f', 'fc294240-296a-46b7-9749-f3a12867a15c', '704babe0-8408-488c-8dbc-4e0ee28a4fe5', 'c7433ed1-ef78-4e15-a9c7-3caf05419690'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:18 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Deleted volume successfully. Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4b6b2ea2-30b7-4842-a761-70e0866cce95 tempest-VolumesTestJSON-796964361 None] Lock "cinder-1d485f48-2bbd-4854-bb26-2d7deceafd50-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:18 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Delete snapshot completed successfully. Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f7df28c1-b077-4598-b7f6-b2879f5586ad tempest-VolumesExtendTest-1512740149 None] Lock "cinder-cdd948bc-3c24-4375-9062-dbfb9fc50988-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Created reservations ['5e1690e7-ce0d-4ac4-a8ac-97caba0b4baa', '19d90a06-69b3-4d47-9fa7-b7d0056725c5', 'c23547a4-4eeb-4a3d-bb4f-86ebe6b7abe9', '5ae9f30c-d3bb-4df1-b43e-4c50d54c7033'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:18 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:18 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Acquiring lock "cinder-7d8188b8-c4ad-4a88-9232-960e26aa37fb-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Lock "cinder-7d8188b8-c4ad-4a88-9232-960e26aa37fb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Acquiring lock "cinder-quobyte-7d8188b8-c4ad-4a88-9232-960e26aa37fb" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:19 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Lock "cinder-quobyte-7d8188b8-c4ad-4a88-9232-960e26aa37fb" acquired by "delete_volume" :: waited 0.032s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.357s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:19 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Deleted volume successfully. Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aa5d73-a8be-405c-ac9b-1239b88e9163]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fbdef2ac-e557-46b6-a673-450e7c45b5b3 tempest-ServerActionsTestOtherA-1138108255 None] Lock "cinder-72081664-b977-457a-a7c9-12b81f297df7-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:19 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb Sep 03 20:09:19 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Acquiring lock "cinder-357903a5-8464-4838-9f8f-c9b4cac3aab9-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] Creating offline snapshot 2853fd4f-41dc-428d-aace-db7c1f41c066 of volume 197081ed-97b2-4373-a25d-4190bc1d254a {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Lock "cinder-357903a5-8464-4838-9f8f-c9b4cac3aab9-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90383a9-b99c-49e1-98b1-7912256566f7]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Acquiring lock "cinder-quobyte-357903a5-8464-4838-9f8f-c9b4cac3aab9" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Lock "cinder-quobyte-357903a5-8464-4838-9f8f-c9b4cac3aab9" acquired by "delete_volume" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dd3b17-3d15-4e7e-aefe-0f321edca728]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-357903a5-8464-4838-9f8f-c9b4cac3aab9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:19 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 Sep 03 20:09:19 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:19 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-357903a5-8464-4838-9f8f-c9b4cac3aab9 Sep 03 20:09:19 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:19 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb" returned: 0 in 0.749s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:20 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb Sep 03 20:09:20 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:20 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445" returned: 0 in 0.652s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-197081ed-97b2-4373-a25d-4190bc1d254a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:20 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 1G Sep 03 20:09:20 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:20 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-357903a5-8464-4838-9f8f-c9b4cac3aab9" returned: 0 in 0.590s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-357903a5-8464-4838-9f8f-c9b4cac3aab9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:20 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-357903a5-8464-4838-9f8f-c9b4cac3aab9 Sep 03 20:09:20 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:20 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7d8188b8-c4ad-4a88-9232-960e26aa37fb" returned: 0 in 0.476s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Lock "cinder-quobyte-7d8188b8-c4ad-4a88-9232-960e26aa37fb" released by "delete_volume" :: held 1.341s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Created reservations ['07022e60-0f73-4244-b432-d7365037b402', '3b515285-9dca-4acc-bcf2-ccd392199f35', 'b564215c-8cea-499b-9412-b97d4a5e1d05', '3c47bdfe-080e-4877-8801-c1adeda583d9'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:20 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:20 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:20 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-357903a5-8464-4838-9f8f-c9b4cac3aab9" returned: 0 in 0.410s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Lock "cinder-quobyte-357903a5-8464-4838-9f8f-c9b4cac3aab9" released by "delete_volume" :: held 1.072s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:20 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 1G" returned: 0 in 0.627s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:20 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Created reservations ['3bb7adeb-1ed0-4cda-8ab1-fb67f74c0ce6', '10876459-b4ed-47db-9c5c-dfa05927e3c9', 'b0ee1652-a2f3-48a2-af92-6d48672c37c4', '3a0c5404-f168-4cb1-a6c1-b39eccf62367'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:20 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 Sep 03 20:09:20 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:21 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:21 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:21 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.366s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:21 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Deleted volume successfully. Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-dfb22d02-5816-4731-bff7-2b69f253d77c tempest-VolumesExtendTest-1512740149 None] Lock "cinder-7d8188b8-c4ad-4a88-9232-960e26aa37fb-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:21 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066" returned: 0 in 0.420s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:21 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 is being set with open permissions: ugo+rw Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:21 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 Sep 03 20:09:21 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:21 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.382s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:21 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Deleted volume successfully. Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-12d5e136-1b4d-42b1-884c-4e47034e0354 tempest-VolumesTestJSON-796964361 None] Lock "cinder-357903a5-8464-4838-9f8f-c9b4cac3aab9-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:21 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066" returned: 0 in 0.324s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.251s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:21 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6c166797-9910-4148-b48c-65fd09fe2241 tempest-VolumesDeleteCascade-998739366 None] Create snapshot completed successfully Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Acquiring lock "cinder-17606b0c-a41c-46d9-8876-212ea3dab7db-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Lock "cinder-17606b0c-a41c-46d9-8876-212ea3dab7db-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Acquiring lock "cinder-quobyte-17606b0c-a41c-46d9-8876-212ea3dab7db" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Lock "cinder-quobyte-17606b0c-a41c-46d9-8876-212ea3dab7db" acquired by "delete_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[64244097-cb68-4ee0-aac5-faf22bef5f0f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-17606b0c-a41c-46d9-8876-212ea3dab7db {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:22 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-17606b0c-a41c-46d9-8876-212ea3dab7db Sep 03 20:09:22 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:22 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-17606b0c-a41c-46d9-8876-212ea3dab7db" returned: 0 in 0.468s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-17606b0c-a41c-46d9-8876-212ea3dab7db {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:22 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-17606b0c-a41c-46d9-8876-212ea3dab7db Sep 03 20:09:22 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-197081ed-97b2-4373-a25d-4190bc1d254a-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-197081ed-97b2-4373-a25d-4190bc1d254a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Performing cascade delete. {{(pid=87582) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-2853fd4f-41dc-428d-aace-db7c1f41c066-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:22 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-17606b0c-a41c-46d9-8876-212ea3dab7db" returned: 0 in 0.336s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-2853fd4f-41dc-428d-aace-db7c1f41c066-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Lock "cinder-quobyte-17606b0c-a41c-46d9-8876-212ea3dab7db" released by "delete_volume" :: held 0.884s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-quobyte-197081ed-97b2-4373-a25d-4190bc1d254a" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-197081ed-97b2-4373-a25d-4190bc1d254a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-quobyte-2853fd4f-41dc-428d-aace-db7c1f41c066" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-2853fd4f-41dc-428d-aace-db7c1f41c066" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Deleting offline snapshot 2853fd4f-41dc-428d-aace-db7c1f41c066 of volume 197081ed-97b2-4373-a25d-4190bc1d254a {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] snapshot_file for this snap is: volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cbabbd-a81d-46ca-b7d6-a5241e3febf0]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:22 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Created reservations ['fbe5a051-7d3a-45df-b480-acbe9729fa33', '5bf691a1-a1a0-4a92-acfe-75a824099838', '92e2e0e2-7b48-4d98-9ad8-bccf8695b953', '674947e0-8621-4e64-b1e9-20e1ec0d7413'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:23 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 Sep 03 20:09:23 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:23 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:23 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:23 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.325s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:23 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066" returned: 0 in 0.482s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-197081ed-97b2-4373-a25d-4190bc1d254a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:09:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Deleted volume successfully. Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa5748b-5ca7-4ed3-8a29-e9293ee930d4]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-270a1160-364b-4758-bf54-c6f20fe8d188 tempest-VolumesTestJSON-796964361 None] Lock "cinder-17606b0c-a41c-46d9-8876-212ea3dab7db-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:23 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 Sep 03 20:09:23 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:23 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445" returned: 0 in 0.410s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-197081ed-97b2-4373-a25d-4190bc1d254a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:09:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:23 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 Sep 03 20:09:23 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:24 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066" returned: 0 in 0.578s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:24 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066 Sep 03 20:09:24 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:24 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.2853fd4f-41dc-428d-aace-db7c1f41c066" returned: 0 in 0.327s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-2853fd4f-41dc-428d-aace-db7c1f41c066" released by "_delete_snapshot" :: held 1.933s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-197081ed-97b2-4373-a25d-4190bc1d254a" released by "delete_snapshot" :: held 1.967s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:24 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Created reservations ['5c80d79a-fa93-436b-91ee-e752e14c68fc', '601bdc93-316e-4326-a028-168c45410b0a', 'a544a179-397c-4dfa-bc2d-ec2577065dcf', 'ddf64b29-8747-4544-a66f-e875618830a4'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:24 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Delete snapshot completed successfully. Sep 03 20:09:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-2853fd4f-41dc-428d-aace-db7c1f41c066-delete_snapshot" released by "delete_snapshot" :: held 2.166s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-86efcf72-d7f6-4483-a45b-d34d4faa0445-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-86efcf72-d7f6-4483-a45b-d34d4faa0445-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-quobyte-197081ed-97b2-4373-a25d-4190bc1d254a" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-197081ed-97b2-4373-a25d-4190bc1d254a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-quobyte-86efcf72-d7f6-4483-a45b-d34d4faa0445" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-86efcf72-d7f6-4483-a45b-d34d4faa0445" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Deleting offline snapshot 86efcf72-d7f6-4483-a45b-d34d4faa0445 of volume 197081ed-97b2-4373-a25d-4190bc1d254a {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:09:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] snapshot_file for this snap is: volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:09:25 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[310909fa-b863-42fa-885d-311412b1d850]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:25 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 Sep 03 20:09:25 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:25 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445" returned: 0 in 0.436s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-197081ed-97b2-4373-a25d-4190bc1d254a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:09:25 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9073f5f-1128-4ed5-a17e-46768b373060]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:25 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a Sep 03 20:09:25 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:26 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a" returned: 0 in 0.418s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:26 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 Sep 03 20:09:26 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:26 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445" returned: 0 in 0.418s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:26 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445 Sep 03 20:09:26 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:26 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a.86efcf72-d7f6-4483-a45b-d34d4faa0445" returned: 0 in 0.277s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-86efcf72-d7f6-4483-a45b-d34d4faa0445" released by "_delete_snapshot" :: held 1.684s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-197081ed-97b2-4373-a25d-4190bc1d254a" released by "delete_snapshot" :: held 1.728s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:26 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Created reservations ['d2df8681-ec68-468d-972d-59cb340a0031', '8f6a263e-f68e-4861-89c6-d494484a8a3f', '1836ab96-6516-40b3-a90e-8038d9163f42', '34632ee9-77ec-4ac3-80a0-0d7a2fe35432'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:26 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Delete snapshot completed successfully. Sep 03 20:09:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-86efcf72-d7f6-4483-a45b-d34d4faa0445-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Snapshots deleted, issuing volume delete {{(pid=87582) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 03 20:09:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-quobyte-197081ed-97b2-4373-a25d-4190bc1d254a" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-197081ed-97b2-4373-a25d-4190bc1d254a" acquired by "delete_volume" :: waited 0.047s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:27 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6174bc9-b6dd-4407-9731-aabaaa256d59]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:27 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a Sep 03 20:09:27 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:27 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a" returned: 0 in 0.389s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:27 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a Sep 03 20:09:27 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:27 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-197081ed-97b2-4373-a25d-4190bc1d254a" returned: 0 in 0.285s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-197081ed-97b2-4373-a25d-4190bc1d254a" released by "delete_volume" :: held 0.769s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:27 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Created reservations ['cb358abd-7ea0-47d0-a63e-10a34c18cac0', '19e56f41-ac00-48b7-bac4-3d3a439e33be', '1d50a5ca-8040-4178-bedc-4195fc05c086', '96b07410-ac9e-48ba-ae63-169ee37821f1'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:27 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:27 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:28 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.361s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:28 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:28 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Deleted volume successfully. Sep 03 20:09:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3d92594-117a-45c1-be38-262e3d9a6df2 tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-197081ed-97b2-4373-a25d-4190bc1d254a-delete_volume" released by "delete_volume" :: held 5.652s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:28 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Flow 'volume_create_manager' (08ab6225-7b5a-4063-911c-c6821f1a12c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7e01e8-1dc6-453e-bc42-ab73f31e9a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7e01e8-1dc6-453e-bc42-ab73f31e9a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2115032802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8112611-f2b1-43a7-9c0e-41518f917050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b976a0ffcb57475aa5f587bdcb44134f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:29Z,use_quota=True,user_id='115bb8265c9b46809c62516e94d5b869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e83047-b1b9-44a9-b881-1398a7474360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e83047-b1b9-44a9-b881-1398a7474360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bac63b7-9586-4358-b35b-d45d069075b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bac63b7-9586-4358-b35b-d45d069075b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8112611-f2b1-43a7-9c0e-41518f917050', 'volume_name': 'volume-d8112611-f2b1-43a7-9c0e-41518f917050', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f67fed-adec-4441-a448-dbe42e64e355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f67fed-adec-4441-a448-dbe42e64e355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8fca62-b23d-4ad3-b836-21e09bd10932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:29 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Volume d8112611-f2b1-43a7-9c0e-41518f917050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8112611-f2b1-43a7-9c0e-41518f917050', 'volume_size': 1} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2115032802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8112611-f2b1-43a7-9c0e-41518f917050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b976a0ffcb57475aa5f587bdcb44134f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:29Z,use_quota=True,user_id='115bb8265c9b46809c62516e94d5b869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Creating volume d8112611-f2b1-43a7-9c0e-41518f917050 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:09:29 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:29 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 1073741824 Sep 03 20:09:29 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:29 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 1073741824" returned: 0 in 0.614s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:29 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 Sep 03 20:09:29 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:30 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050" returned: 0 in 0.451s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:09:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8fca62-b23d-4ad3-b836-21e09bd10932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8112611-f2b1-43a7-9c0e-41518f917050', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf6c408-cb03-47b6-9fea-57a6b23f1646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:30 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Volume volume-d8112611-f2b1-43a7-9c0e-41518f917050 (d8112611-f2b1-43a7-9c0e-41518f917050): created successfully Sep 03 20:09:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf6c408-cb03-47b6-9fea-57a6b23f1646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Flow 'volume_create_manager' (08ab6225-7b5a-4063-911c-c6821f1a12c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:30 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e3cbd51c-3a26-471f-b024-9c2e0597cf93 tempest-VolumesDeleteCascade-998739366 None] Created volume successfully. Sep 03 20:09:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] Creating offline snapshot 357c0196-cfa1-4d4b-818f-5346ef34fc05 of volume d8112611-f2b1-43a7-9c0e-41518f917050 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:09:31 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9e1e7c-3b13-4896-a796-e3fcba1c195b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:31 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 Sep 03 20:09:31 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:32 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050" returned: 0 in 0.452s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:32 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 1G Sep 03 20:09:32 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:32 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 1G" returned: 0 in 0.680s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8112611-f2b1-43a7-9c0e-41518f917050 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:32 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8112611-f2b1-43a7-9c0e-41518f917050 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 Sep 03 20:09:32 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:33 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8112611-f2b1-43a7-9c0e-41518f917050 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05" returned: 0 in 0.407s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:33 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 is being set with open permissions: ugo+rw Sep 03 20:09:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:33 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 Sep 03 20:09:33 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:33 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05" returned: 0 in 0.402s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:33 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.info Sep 03 20:09:33 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:33 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.info" returned: 0 in 0.324s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:33 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.info is being set with open permissions: ugo+rw Sep 03 20:09:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:33 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.info Sep 03 20:09:33 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:34 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.info" returned: 0 in 0.324s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.766s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:34 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-90ac525d-fa82-4abb-8656-67e84ecce888 tempest-VolumesDeleteCascade-998739366 None] Create snapshot completed successfully Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Flow 'volume_create_manager' (3f8cf6af-e066-4512-9710-a9f9939feb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fcee3d-a38f-42b2-ba35-ebe1e0819632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fcee3d-a38f-42b2-ba35-ebe1e0819632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-159256049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bcc7d2-6d02-437a-a6b6-c56055a98390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b976a0ffcb57475aa5f587bdcb44134f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=357c0196-cfa1-4d4b-818f-5346ef34fc05,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:35Z,use_quota=True,user_id='115bb8265c9b46809c62516e94d5b869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b5b739-7135-4b2f-9eee-1cdf85df8aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b5b739-7135-4b2f-9eee-1cdf85df8aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645072d6-91b7-46a2-81c2-24d0cb367d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645072d6-91b7-46a2-81c2-24d0cb367d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45bcc7d2-6d02-437a-a6b6-c56055a98390', 'volume_name': 'volume-45bcc7d2-6d02-437a-a6b6-c56055a98390', 'volume_size': 1, 'snapshot_id': '357c0196-cfa1-4d4b-818f-5346ef34fc05'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65670f85-e39a-4bc5-8e22-6c0a5e148559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65670f85-e39a-4bc5-8e22-6c0a5e148559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561df04f-346f-481f-826f-fe56e7bb9706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:35 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Volume 45bcc7d2-6d02-437a-a6b6-c56055a98390: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45bcc7d2-6d02-437a-a6b6-c56055a98390', 'volume_size': 1, 'snapshot_id': '357c0196-cfa1-4d4b-818f-5346ef34fc05'} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-quobyte-357c0196-cfa1-4d4b-818f-5346ef34fc05-45bcc7d2-6d02-437a-a6b6-c56055a98390" by "_create_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-357c0196-cfa1-4d4b-818f-5346ef34fc05-45bcc7d2-6d02-437a-a6b6-c56055a98390" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Creating volume 45bcc7d2-6d02-437a-a6b6-c56055a98390 from snapshot 357c0196-cfa1-4d4b-818f-5346ef34fc05 {{(pid=87582) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-quobyte-45bcc7d2-6d02-437a-a6b6-c56055a98390" by "_copy_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-45bcc7d2-6d02-437a-a6b6-c56055a98390" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] snapshot: 357c0196-cfa1-4d4b-818f-5346ef34fc05, volume: 45bcc7d2-6d02-437a-a6b6-c56055a98390, {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[56159e3d-6df9-40bf-9b57-d3f51f6ebf8d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:35 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 Sep 03 20:09:35 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:36 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05" returned: 0 in 0.491s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8112611-f2b1-43a7-9c0e-41518f917050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f1729e-4b72-4587-aa9b-8b3f57a73fbf]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:36 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 Sep 03 20:09:36 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:36 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:36 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:36 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050" returned: 0 in 0.519s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Creating direct copy from snapshot {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG cinder.utils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Path /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390 not found in is_blk_device check {{(pid=87582) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 20:09:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:36 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390 Sep 03 20:09:36 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:37 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.502s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:09:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 28 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:09:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:09:43 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390" returned: 0 in 6.849s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:43 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:09:43 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Converted 1024.00 MB image at 149.48 MB/s Sep 03 20:09:43 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390 is being set with open permissions: ugo+rw Sep 03 20:09:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:43 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390 Sep 03 20:09:43 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:44 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390" returned: 0 in 0.449s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-45bcc7d2-6d02-437a-a6b6-c56055a98390" released by "_copy_volume_from_snapshot" :: held 8.443s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-357c0196-cfa1-4d4b-818f-5346ef34fc05-45bcc7d2-6d02-437a-a6b6-c56055a98390" released by "_create_volume_from_snapshot" :: held 8.551s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.579s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561df04f-346f-481f-826f-fe56e7bb9706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45bcc7d2-6d02-437a-a6b6-c56055a98390', 'volume_size': 1, 'snapshot_id': '357c0196-cfa1-4d4b-818f-5346ef34fc05'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6cc8296-1e53-4f85-9b34-3ca771b3fd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Flow 'volume_create_manager' (39345e87-9ef0-4767-bf68-93f6824fff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904436b7-2a08-4261-8b2f-88fdd74ab926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:44 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Volume volume-45bcc7d2-6d02-437a-a6b6-c56055a98390 (45bcc7d2-6d02-437a-a6b6-c56055a98390): created successfully Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6cc8296-1e53-4f85-9b34-3ca771b3fd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Flow 'volume_create_manager' (3f8cf6af-e066-4512-9710-a9f9939feb6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904436b7-2a08-4261-8b2f-88fdd74ab926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1603719556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34698e93e6dd4f84a70c58345a53f0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:44Z,use_quota=True,user_id='1408b389b81048e78ea0c90d7e74a38b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb22476e-5678-4534-a440-948eab8f7bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb22476e-5678-4534-a440-948eab8f7bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379c6cd0-3aad-4444-b908-9b92e40b91e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379c6cd0-3aad-4444-b908-9b92e40b91e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc', 'volume_name': 'volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc66727e-71cf-4257-ad38-a30cf3da2664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc66727e-71cf-4257-ad38-a30cf3da2664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5101e738-bd1e-402b-af3c-a029a73239c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:44 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Volume c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc', 'volume_size': 1} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1603719556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34698e93e6dd4f84a70c58345a53f0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:44Z,use_quota=True,user_id='1408b389b81048e78ea0c90d7e74a38b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Creating volume c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:09:44 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:44 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-362eb821-50c7-4058-9cc5-fbbc749d73fe tempest-VolumesDeleteCascade-998739366 None] Created volume successfully. Sep 03 20:09:44 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc 1073741824 Sep 03 20:09:44 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-d8112611-f2b1-43a7-9c0e-41518f917050-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-d8112611-f2b1-43a7-9c0e-41518f917050-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Performing cascade delete. {{(pid=87582) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-357c0196-cfa1-4d4b-818f-5346ef34fc05-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-357c0196-cfa1-4d4b-818f-5346ef34fc05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-quobyte-d8112611-f2b1-43a7-9c0e-41518f917050" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-d8112611-f2b1-43a7-9c0e-41518f917050" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-quobyte-357c0196-cfa1-4d4b-818f-5346ef34fc05" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-357c0196-cfa1-4d4b-818f-5346ef34fc05" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Deleting offline snapshot 357c0196-cfa1-4d4b-818f-5346ef34fc05 of volume d8112611-f2b1-43a7-9c0e-41518f917050 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:09:45 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] snapshot_file for this snap is: volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc 1073741824" returned: 0 in 0.668s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de92b0f-aff2-4c4e-8f08-bc0ce7669a3a]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:45 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc Sep 03 20:09:45 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:45 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 Sep 03 20:09:45 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:45 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc" returned: 0 in 0.303s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5101e738-bd1e-402b-af3c-a029a73239c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01a6aa3-5af9-4086-87d6-aa6628794a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:45 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Volume volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc (c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc): created successfully Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01a6aa3-5af9-4086-87d6-aa6628794a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Flow 'volume_create_manager' (39345e87-9ef0-4767-bf68-93f6824fff2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:45 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5a9bbb57-0193-419b-9167-b6776067c4d0 tempest-VolumeQuotasAdminTestJSON-1239184416 None] Created volume successfully. Sep 03 20:09:45 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05" returned: 0 in 0.467s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8112611-f2b1-43a7-9c0e-41518f917050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade35f00-a6e5-42d1-a637-7ea13640b95a]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:45 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 Sep 03 20:09:45 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:46 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050" returned: 0 in 0.585s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:46 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 Sep 03 20:09:46 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:46 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9b006862-a429-424d-b261-107b3de4dc97 tempest-GroupsTest-1917888673 None] Group tempest-Group1-218383661: creating Sep 03 20:09:46 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9b006862-a429-424d-b261-107b3de4dc97 tempest-GroupsTest-1917888673 None] Group tempest-Group1-218383661: created successfully Sep 03 20:09:46 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9b006862-a429-424d-b261-107b3de4dc97 tempest-GroupsTest-1917888673 None] Create group completed successfully. Sep 03 20:09:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Acquiring lock "cinder-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "cinder-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Acquiring lock "cinder-quobyte-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "cinder-quobyte-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:46 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92c4bd3-ed3d-4a92-84af-192f7525920d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:46 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05" returned: 0 in 0.480s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:46 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc Sep 03 20:09:46 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:46 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05 Sep 03 20:09:46 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:47 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050.357c0196-cfa1-4d4b-818f-5346ef34fc05" returned: 0 in 0.305s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-357c0196-cfa1-4d4b-818f-5346ef34fc05" released by "_delete_snapshot" :: held 1.967s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:47 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc" returned: 0 in 0.459s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-d8112611-f2b1-43a7-9c0e-41518f917050" released by "delete_snapshot" :: held 2.011s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:47 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc Sep 03 20:09:47 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Created reservations ['465d7721-e14b-4d7e-98a2-f8921fed857e', 'cc19dd50-eaf3-44b1-8da7-822093a92485', 'e8de2afa-266a-4e90-86ea-a4553a0a5478', '37d3a8a4-f78a-46dd-b8e8-7c131b61efb6'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Delete snapshot completed successfully. Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-357c0196-cfa1-4d4b-818f-5346ef34fc05-delete_snapshot" released by "delete_snapshot" :: held 2.241s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Snapshots deleted, issuing volume delete {{(pid=87582) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-quobyte-d8112611-f2b1-43a7-9c0e-41518f917050" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-d8112611-f2b1-43a7-9c0e-41518f917050" acquired by "delete_volume" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f9a6fa-d279-4852-9e5b-99330ffdbbbd]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:47 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc" returned: 0 in 0.303s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "cinder-quobyte-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc" released by "delete_volume" :: held 0.818s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Created reservations ['c51f76ff-327c-4b88-bfd0-175677a0de3f', '8e5dbed0-cc58-4af5-b34d-0d1635536d11', '80b66ac0-a11b-43bd-b005-f2a947e1212f', '90b2d77a-ddcd-45cf-8f33-9414a2e8ab88'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:47 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 Sep 03 20:09:47 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-387f3994-b452-48b3-b4af-b77c5eb21ed1 tempest-GroupsTest-1917888673 None] Group tempest-Group2-1045640068: creating Sep 03 20:09:47 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:47 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-387f3994-b452-48b3-b4af-b77c5eb21ed1 tempest-GroupsTest-1917888673 None] Group tempest-Group2-1045640068: created successfully Sep 03 20:09:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-387f3994-b452-48b3-b4af-b77c5eb21ed1 tempest-GroupsTest-1917888673 None] Create group completed successfully. Sep 03 20:09:47 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050" returned: 0 in 0.504s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:47 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.319s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:47 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050 Sep 03 20:09:47 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Deleted volume successfully. Sep 03 20:09:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b6409e27-abaa-43f4-8b65-d56f7174ed4e tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "cinder-c3aa2500-8fe2-46e3-96ef-06d4e2eb1ddc-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:48 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8112611-f2b1-43a7-9c0e-41518f917050" returned: 0 in 0.317s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-d8112611-f2b1-43a7-9c0e-41518f917050" released by "delete_volume" :: held 0.925s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Created reservations ['21ada08b-c375-45c5-9587-b34c2942ec20', 'f552d2a6-6a6b-482d-8943-b27c61f6368b', 'a8793c82-be42-447c-a9e1-b2b0b3f504e6', '607406e3-7cc7-49b6-8762-b5219d1a5974'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:48 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:48 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Flow 'volume_create_manager' (3fefd9da-1c28-4f56-b02a-692579f9eaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a4c068-a4d3-4447-a104-742e85f2fb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a4c068-a4d3-4447-a104-742e85f2fb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-954668752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044d71d8-3fff-4cb4-81d9-65947a1520c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34698e93e6dd4f84a70c58345a53f0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:48Z,use_quota=True,user_id='1408b389b81048e78ea0c90d7e74a38b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca2a1c8-7011-4ce5-8921-4315730331ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca2a1c8-7011-4ce5-8921-4315730331ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b3f058-9ad1-4ef5-b6c7-e16de68372eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b3f058-9ad1-4ef5-b6c7-e16de68372eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '044d71d8-3fff-4cb4-81d9-65947a1520c0', 'volume_name': 'volume-044d71d8-3fff-4cb4-81d9-65947a1520c0', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d498b442-7571-4166-a3c1-f959d56fd5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d498b442-7571-4166-a3c1-f959d56fd5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16e0c9b-7260-42a5-8cc2-2b1884f3d527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:48 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Volume 044d71d8-3fff-4cb4-81d9-65947a1520c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-044d71d8-3fff-4cb4-81d9-65947a1520c0', 'volume_size': 1} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-954668752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044d71d8-3fff-4cb4-81d9-65947a1520c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34698e93e6dd4f84a70c58345a53f0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:48Z,use_quota=True,user_id='1408b389b81048e78ea0c90d7e74a38b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Creating volume 044d71d8-3fff-4cb4-81d9-65947a1520c0 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:09:48 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-044d71d8-3fff-4cb4-81d9-65947a1520c0 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:48 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-044d71d8-3fff-4cb4-81d9-65947a1520c0 1073741824 Sep 03 20:09:48 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:48 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.302s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Deleted volume successfully. Sep 03 20:09:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5095fdb7-c252-4840-97d7-7b792357e4ae tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-d8112611-f2b1-43a7-9c0e-41518f917050-delete_volume" released by "delete_volume" :: held 3.795s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:49 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-044d71d8-3fff-4cb4-81d9-65947a1520c0 1073741824" returned: 0 in 0.537s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-044d71d8-3fff-4cb4-81d9-65947a1520c0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:49 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-044d71d8-3fff-4cb4-81d9-65947a1520c0 Sep 03 20:09:49 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Flow 'volume_create_manager' (5ca62213-5869-4d39-8efc-aa3a194c7f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c2cce9-935b-4c86-bd0d-81e2f0f66c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c2cce9-935b-4c86-bd0d-81e2f0f66c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919558870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d03c3da-bae5-44a9-96d0-354cf1094aad,host='devstack@QuobyteHD#QuobyteHD',id=a867d0c0-c60e-4575-b44b-2462896495f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c788af9d23fe4b899b6cf84ecd6ccf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:49Z,use_quota=True,user_id='d19ffe24044946e1bcffc847058e1e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0819260e-f91c-4e53-ab39-8a4dd20c26c7),volume_type_id=0819260e-f91c-4e53-ab39-8a4dd20c26c7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc44abf-b35a-4354-88e1-22b81100e09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc44abf-b35a-4354-88e1-22b81100e09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bf2d9f-04f1-4c7c-8b64-08e0fe4a23db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bf2d9f-04f1-4c7c-8b64-08e0fe4a23db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a867d0c0-c60e-4575-b44b-2462896495f7', 'volume_name': 'volume-a867d0c0-c60e-4575-b44b-2462896495f7', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee251a5-74ce-4cd4-8ff7-d999a7d0554d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee251a5-74ce-4cd4-8ff7-d999a7d0554d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd8c2f4-4b3f-408f-9ada-5535e838cab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:49 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Volume a867d0c0-c60e-4575-b44b-2462896495f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a867d0c0-c60e-4575-b44b-2462896495f7', 'volume_size': 1} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:49 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-044d71d8-3fff-4cb4-81d9-65947a1520c0" returned: 0 in 0.358s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5d03c3da-bae5-44a9-96d0-354cf1094aad,created_at=2026-09-03T18:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919558870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d03c3da-bae5-44a9-96d0-354cf1094aad,host='devstack@QuobyteHD#QuobyteHD',id=a867d0c0-c60e-4575-b44b-2462896495f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c788af9d23fe4b899b6cf84ecd6ccf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:49Z,use_quota=True,user_id='d19ffe24044946e1bcffc847058e1e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0819260e-f91c-4e53-ab39-8a4dd20c26c7),volume_type_id=0819260e-f91c-4e53-ab39-8a4dd20c26c7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Creating volume a867d0c0-c60e-4575-b44b-2462896495f7 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:09:49 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a867d0c0-c60e-4575-b44b-2462896495f7 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16e0c9b-7260-42a5-8cc2-2b1884f3d527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-044d71d8-3fff-4cb4-81d9-65947a1520c0', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:49 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a867d0c0-c60e-4575-b44b-2462896495f7 1073741824 Sep 03 20:09:49 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a325308b-95f0-4e5d-b6d3-72237035a9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:49 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Volume volume-044d71d8-3fff-4cb4-81d9-65947a1520c0 (044d71d8-3fff-4cb4-81d9-65947a1520c0): created successfully Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a325308b-95f0-4e5d-b6d3-72237035a9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Flow 'volume_create_manager' (3fefd9da-1c28-4f56-b02a-692579f9eaad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:49 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6c165f0c-7826-4aeb-a564-c6b003f3c00f tempest-VolumeQuotasAdminTestJSON-1239184416 None] Created volume successfully. Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-45bcc7d2-6d02-437a-a6b6-c56055a98390-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-45bcc7d2-6d02-437a-a6b6-c56055a98390-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "cinder-quobyte-45bcc7d2-6d02-437a-a6b6-c56055a98390" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-45bcc7d2-6d02-437a-a6b6-c56055a98390" acquired by "delete_volume" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d06e8a2-95c3-4cce-8aad-323ceffe9400]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:49 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390 Sep 03 20:09:49 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:50 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a867d0c0-c60e-4575-b44b-2462896495f7 1073741824" returned: 0 in 0.553s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a867d0c0-c60e-4575-b44b-2462896495f7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:50 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a867d0c0-c60e-4575-b44b-2462896495f7 Sep 03 20:09:50 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:50 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390" returned: 0 in 0.440s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:50 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390 Sep 03 20:09:50 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:50 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a867d0c0-c60e-4575-b44b-2462896495f7" returned: 0 in 0.301s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd8c2f4-4b3f-408f-9ada-5535e838cab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a867d0c0-c60e-4575-b44b-2462896495f7', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df14492f-abae-4d77-af45-a22688b39ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:50 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Volume volume-a867d0c0-c60e-4575-b44b-2462896495f7 (a867d0c0-c60e-4575-b44b-2462896495f7): created successfully Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df14492f-abae-4d77-af45-a22688b39ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Flow 'volume_create_manager' (5ca62213-5869-4d39-8efc-aa3a194c7f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-4d9a6316-2ca6-4380-9230-eab3791c032e tempest-GroupsTest-1917888673 None] Created volume successfully. Sep 03 20:09:50 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-45bcc7d2-6d02-437a-a6b6-c56055a98390" returned: 0 in 0.303s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-quobyte-45bcc7d2-6d02-437a-a6b6-c56055a98390" released by "delete_volume" :: held 0.801s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Created reservations ['76692472-2e52-49a0-baff-b78a2e57d6d8', '173a268c-bd5a-46df-a53e-3ce8d72cd38d', '2611a475-e708-472b-95b1-73037eb1220a', '5644d04b-5be9-438d-bc7c-f7f620fc8ba2'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:50 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:50 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:51 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.408s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:51 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:51 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Deleted volume successfully. Sep 03 20:09:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fe7fdc57-5480-4846-acf5-4f3d914d449a tempest-VolumesDeleteCascade-998739366 None] Lock "cinder-45bcc7d2-6d02-437a-a6b6-c56055a98390-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:51 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a7456d00-4c12-41f8-b9a3-9dff144009b7 tempest-VolumeQuotasAdminTestJSON-1249364244 None] Transfer volume completed successfully. Sep 03 20:09:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Acquiring lock "cinder-quobyte-a867d0c0-c60e-4575-b44b-2462896495f7" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Lock "cinder-quobyte-a867d0c0-c60e-4575-b44b-2462896495f7" acquired by "delete_volume" :: waited 0.038s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:51 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b50ac1-125c-4abd-8615-810a3ec0b0cf]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a867d0c0-c60e-4575-b44b-2462896495f7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:52 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a867d0c0-c60e-4575-b44b-2462896495f7 Sep 03 20:09:52 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:52 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a867d0c0-c60e-4575-b44b-2462896495f7" returned: 0 in 0.526s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a867d0c0-c60e-4575-b44b-2462896495f7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:52 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a867d0c0-c60e-4575-b44b-2462896495f7 Sep 03 20:09:52 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Acquiring lock "cinder-044d71d8-3fff-4cb4-81d9-65947a1520c0-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Lock "cinder-044d71d8-3fff-4cb4-81d9-65947a1520c0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Acquiring lock "cinder-quobyte-044d71d8-3fff-4cb4-81d9-65947a1520c0" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Lock "cinder-quobyte-044d71d8-3fff-4cb4-81d9-65947a1520c0" acquired by "delete_volume" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:52 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f7e592-ab88-49a9-9a32-b115f6f7b722]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-044d71d8-3fff-4cb4-81d9-65947a1520c0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:52 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a867d0c0-c60e-4575-b44b-2462896495f7" returned: 0 in 0.460s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Lock "cinder-quobyte-a867d0c0-c60e-4575-b44b-2462896495f7" released by "delete_volume" :: held 1.046s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:52 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-044d71d8-3fff-4cb4-81d9-65947a1520c0 Sep 03 20:09:52 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:52 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Created reservations ['1fbed614-b39e-44ae-87a4-509a4319a11a'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:53 devstack cinder-volume[87582]: WARNING cinder.quota [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1047744585 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1047744585, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:09:53 devstack cinder-volume[87582]: WARNING cinder.quota [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1047744585 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1047744585, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Created reservations ['1a5e541d-38ec-4b19-8b57-64b1388acc65', 'c8c200e4-bc59-4b80-a01c-49545ae551ca', 'eb337278-5ce5-45d3-abde-eb6996aff963', '1808f50a-be4e-4745-95dd-6d8d8d842647'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:53 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:53 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:53 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-044d71d8-3fff-4cb4-81d9-65947a1520c0" returned: 0 in 0.632s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-044d71d8-3fff-4cb4-81d9-65947a1520c0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:53 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-044d71d8-3fff-4cb4-81d9-65947a1520c0 Sep 03 20:09:53 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:53 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.381s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:53 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-160ce77a-5424-41e4-9abf-2f12af100b86 tempest-GroupsTest-1917888673 None] Delete group completed successfully. Sep 03 20:09:53 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-044d71d8-3fff-4cb4-81d9-65947a1520c0" returned: 0 in 0.304s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Lock "cinder-quobyte-044d71d8-3fff-4cb4-81d9-65947a1520c0" released by "delete_volume" :: held 1.000s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Created reservations ['3e8a51df-8fc1-44fe-b4d8-829ca272959f', 'd8ac0ccf-18c1-4629-ae70-d7cd2664434d', '94e5b7c7-3fef-4776-a1ad-d0708eb0ffb8', 'f862053e-8a5d-4892-a608-568b33c01deb'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:53 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:53 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:54 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.333s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:54 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:54 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Deleted volume successfully. Sep 03 20:09:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d1874ff5-6ed8-41b8-b705-f5077b8227fe tempest-VolumeQuotasAdminTestJSON-1298269844 None] Lock "cinder-044d71d8-3fff-4cb4-81d9-65947a1520c0-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:09:54 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-f6fd48f3-ba71-427b-a8b2-25d5ac6ccdbc tempest-GroupsTest-1917888673 None] Created reservations ['d288d71c-4f84-4061-b2dc-62e61469c590'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:09:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f6fd48f3-ba71-427b-a8b2-25d5ac6ccdbc tempest-GroupsTest-1917888673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f6fd48f3-ba71-427b-a8b2-25d5ac6ccdbc tempest-GroupsTest-1917888673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f6fd48f3-ba71-427b-a8b2-25d5ac6ccdbc tempest-GroupsTest-1917888673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f6fd48f3-ba71-427b-a8b2-25d5ac6ccdbc tempest-GroupsTest-1917888673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f6fd48f3-ba71-427b-a8b2-25d5ac6ccdbc tempest-GroupsTest-1917888673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f6fd48f3-ba71-427b-a8b2-25d5ac6ccdbc tempest-GroupsTest-1917888673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:54 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:09:54 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:54 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f6fd48f3-ba71-427b-a8b2-25d5ac6ccdbc tempest-GroupsTest-1917888673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.328s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:54 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-f6fd48f3-ba71-427b-a8b2-25d5ac6ccdbc tempest-GroupsTest-1917888673 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:09:54 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f6fd48f3-ba71-427b-a8b2-25d5ac6ccdbc tempest-GroupsTest-1917888673 None] Delete group completed successfully. Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Flow 'volume_create_manager' (a016d103-ce4b-4fa8-9e2b-b7aa6998a82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6900a80e-d971-4389-9142-bbbb761fea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6900a80e-d971-4389-9142-bbbb761fea3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1352726960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12da9ed-5798-4b76-a3ae-0966b9b4d089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bd5443649f44d08b6aba9d1d7a6c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:56Z,use_quota=True,user_id='e2a9104faca64a5a9ded15a13235be87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7750cf02-ede4-4362-846d-9857dc4ce92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7750cf02-ede4-4362-846d-9857dc4ce92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead7840d-22ce-465e-8727-c5c10cf098ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead7840d-22ce-465e-8727-c5c10cf098ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a12da9ed-5798-4b76-a3ae-0966b9b4d089', 'volume_name': 'volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5ecaa0-6810-4c66-96ea-21b82a958be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5ecaa0-6810-4c66-96ea-21b82a958be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4989bb9-be9b-4458-9bfa-768fa8fdf95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:56 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Volume a12da9ed-5798-4b76-a3ae-0966b9b4d089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089', 'volume_size': 1} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1352726960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12da9ed-5798-4b76-a3ae-0966b9b4d089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bd5443649f44d08b6aba9d1d7a6c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:56Z,use_quota=True,user_id='e2a9104faca64a5a9ded15a13235be87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Creating volume a12da9ed-5798-4b76-a3ae-0966b9b4d089 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:09:56 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:56 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089 1073741824 Sep 03 20:09:56 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f298c1f7-d158-4bfa-a887-4dc233a1b410 tempest-GroupsTest-1917888673 None] Group tempest-GroupsTest-Group-1842202516: creating Sep 03 20:09:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f298c1f7-d158-4bfa-a887-4dc233a1b410 tempest-GroupsTest-1917888673 None] Group tempest-GroupsTest-Group-1842202516: created successfully Sep 03 20:09:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f298c1f7-d158-4bfa-a887-4dc233a1b410 tempest-GroupsTest-1917888673 None] Create group completed successfully. Sep 03 20:09:56 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089 1073741824" returned: 0 in 0.615s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:56 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089 Sep 03 20:09:56 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:57 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089" returned: 0 in 0.297s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:09:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4989bb9-be9b-4458-9bfa-768fa8fdf95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737962a8-f09e-43d9-824b-87bfe4b8d38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:57 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Volume volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089 (a12da9ed-5798-4b76-a3ae-0966b9b4d089): created successfully Sep 03 20:09:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737962a8-f09e-43d9-824b-87bfe4b8d38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Flow 'volume_create_manager' (a016d103-ce4b-4fa8-9e2b-b7aa6998a82f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:57 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-3765801a-b3dd-4cca-a7b6-9475f55fff00 tempest-VolumesMetadataTest-444197437 None] Created volume successfully. Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Flow 'volume_create_manager' (2bd6cef8-c182-4897-a2ad-f927c817a70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c44f95f-eeee-4057-9a86-2a42a80c8236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c44f95f-eeee-4057-9a86-2a42a80c8236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1088231998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d12bb523-211e-4f0b-925d-f70693a9d6d0,host='devstack@QuobyteHD#QuobyteHD',id=94850303-2c9f-4072-ada9-2524ce857a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c788af9d23fe4b899b6cf84ecd6ccf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:58Z,use_quota=True,user_id='d19ffe24044946e1bcffc847058e1e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c4d0944-296d-48fe-8505-e8f731b550a2),volume_type_id=7c4d0944-296d-48fe-8505-e8f731b550a2)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fd5bc3-53cd-403d-9657-7fc6376ef54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fd5bc3-53cd-403d-9657-7fc6376ef54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ab1554-84f3-4947-8f07-46f1145bddbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ab1554-84f3-4947-8f07-46f1145bddbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94850303-2c9f-4072-ada9-2524ce857a2b', 'volume_name': 'volume-94850303-2c9f-4072-ada9-2524ce857a2b', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2ac4cb-7de8-4dfa-ade8-8f9bc93f2975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2ac4cb-7de8-4dfa-ade8-8f9bc93f2975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31be860f-44d3-4f4a-8bc3-223a6daa0d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:58 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Volume 94850303-2c9f-4072-ada9-2524ce857a2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94850303-2c9f-4072-ada9-2524ce857a2b', 'volume_size': 1} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d12bb523-211e-4f0b-925d-f70693a9d6d0,created_at=2026-09-03T18:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1088231998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d12bb523-211e-4f0b-925d-f70693a9d6d0,host='devstack@QuobyteHD#QuobyteHD',id=94850303-2c9f-4072-ada9-2524ce857a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c788af9d23fe4b899b6cf84ecd6ccf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:09:58Z,use_quota=True,user_id='d19ffe24044946e1bcffc847058e1e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c4d0944-296d-48fe-8505-e8f731b550a2),volume_type_id=7c4d0944-296d-48fe-8505-e8f731b550a2)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Creating volume 94850303-2c9f-4072-ada9-2524ce857a2b {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:09:58 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:09:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-94850303-2c9f-4072-ada9-2524ce857a2b 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:58 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-94850303-2c9f-4072-ada9-2524ce857a2b 1073741824 Sep 03 20:09:58 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:59 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-94850303-2c9f-4072-ada9-2524ce857a2b 1073741824" returned: 0 in 0.770s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-94850303-2c9f-4072-ada9-2524ce857a2b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:59 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-94850303-2c9f-4072-ada9-2524ce857a2b Sep 03 20:09:59 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:09:59 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-94850303-2c9f-4072-ada9-2524ce857a2b" returned: 0 in 0.462s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Acquiring lock "cinder-a12da9ed-5798-4b76-a3ae-0966b9b4d089-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31be860f-44d3-4f4a-8bc3-223a6daa0d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94850303-2c9f-4072-ada9-2524ce857a2b', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f111ce6-0569-4052-a81d-49f8c0a19b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Lock "cinder-a12da9ed-5798-4b76-a3ae-0966b9b4d089-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:59 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Volume volume-94850303-2c9f-4072-ada9-2524ce857a2b (94850303-2c9f-4072-ada9-2524ce857a2b): created successfully Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f111ce6-0569-4052-a81d-49f8c0a19b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Flow 'volume_create_manager' (2bd6cef8-c182-4897-a2ad-f927c817a70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:09:59 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-57e50db2-15bd-45a4-bf9f-85804df7e7bc tempest-GroupsTest-1917888673 None] Created volume successfully. Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Acquiring lock "cinder-quobyte-a12da9ed-5798-4b76-a3ae-0966b9b4d089" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Lock "cinder-quobyte-a12da9ed-5798-4b76-a3ae-0966b9b4d089" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d6a29d-250b-488b-a495-86c444a94e48]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:09:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:09:59 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089 Sep 03 20:09:59 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:00 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089" returned: 0 in 0.448s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:00 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089 Sep 03 20:10:00 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:00 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a12da9ed-5798-4b76-a3ae-0966b9b4d089" returned: 0 in 0.393s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Lock "cinder-quobyte-a12da9ed-5798-4b76-a3ae-0966b9b4d089" released by "delete_volume" :: held 0.902s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:00 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Created reservations ['5092a3d6-0052-453b-854e-b15afc30396e', '1b54659e-8759-434e-a894-475dc3deb7a9', '36aab2b8-9b02-4d11-9dbf-e2a8e5e7f60b', 'eb410ab4-d314-4262-a4b5-fa17e9ed8d3d'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:00 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:10:00 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:01 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.345s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:10:01 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Deleted volume successfully. Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5124e433-a18c-4c83-ae5b-c5312a920bfc tempest-VolumesMetadataTest-444197437 None] Lock "cinder-a12da9ed-5798-4b76-a3ae-0966b9b4d089-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=172,cinder:INSERT=44,cinder:UPDATE=202,cinder:DELETE=11 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Flow 'volume_create_manager' (1f67b662-f06c-4eeb-b5e3-ccf02ada25c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306ac910-8678-4c36-9eb8-86ab86438487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306ac910-8678-4c36-9eb8-86ab86438487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2035680982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d12bb523-211e-4f0b-925d-f70693a9d6d0,host='devstack@QuobyteHD#QuobyteHD',id=b182e2a8-deb8-49d2-a838-529b8ee1e2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c788af9d23fe4b899b6cf84ecd6ccf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:02Z,use_quota=True,user_id='d19ffe24044946e1bcffc847058e1e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c4d0944-296d-48fe-8505-e8f731b550a2),volume_type_id=7c4d0944-296d-48fe-8505-e8f731b550a2)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0497d4c0-73ab-47b2-9471-d1309aa05602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0497d4c0-73ab-47b2-9471-d1309aa05602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e382b9-3243-4878-b305-b3a3b866c83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e382b9-3243-4878-b305-b3a3b866c83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b182e2a8-deb8-49d2-a838-529b8ee1e2ea', 'volume_name': 'volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c1e670-5524-49e0-a113-3411005f5aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c1e670-5524-49e0-a113-3411005f5aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11e9af9-6fd5-4667-a32c-01941354b561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:01 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Volume b182e2a8-deb8-49d2-a838-529b8ee1e2ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea', 'volume_size': 1} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d12bb523-211e-4f0b-925d-f70693a9d6d0,created_at=2026-09-03T18:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2035680982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d12bb523-211e-4f0b-925d-f70693a9d6d0,host='devstack@QuobyteHD#QuobyteHD',id=b182e2a8-deb8-49d2-a838-529b8ee1e2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c788af9d23fe4b899b6cf84ecd6ccf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:02Z,use_quota=True,user_id='d19ffe24044946e1bcffc847058e1e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c4d0944-296d-48fe-8505-e8f731b550a2),volume_type_id=7c4d0944-296d-48fe-8505-e8f731b550a2)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Creating volume b182e2a8-deb8-49d2-a838-529b8ee1e2ea {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:10:01 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:10:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:01 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea 1073741824 Sep 03 20:10:01 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:02 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea 1073741824" returned: 0 in 0.685s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:02 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea Sep 03 20:10:02 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:02 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea" returned: 0 in 0.359s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:10:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11e9af9-6fd5-4667-a32c-01941354b561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674171a1-5d38-4b02-be8d-1c9ae120760a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:02 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Volume volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea (b182e2a8-deb8-49d2-a838-529b8ee1e2ea): created successfully Sep 03 20:10:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674171a1-5d38-4b02-be8d-1c9ae120760a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Flow 'volume_create_manager' (1f67b662-f06c-4eeb-b5e3-ccf02ada25c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:02 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6c4b8db8-28c5-4a13-ad73-86ffbe668698 tempest-GroupsTest-1917888673 None] Created volume successfully. Sep 03 20:10:04 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-51da13be-ccec-437b-a368-f9415ce18711 tempest-GroupsTest-1917888673 None] Update group completed successfully. Sep 03 20:10:05 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7c488e05-5757-4186-bdc3-2422ed1c4486 tempest-GroupsTest-1917888673 None] Update group completed successfully. Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Flow 'volume_create_manager' (7d3bcd4b-ac85-4951-a594-717bda1fc411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874a0033-6891-414e-9650-b4f0f68a2a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874a0033-6891-414e-9650-b4f0f68a2a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-387530535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc31ec7-2e5c-47b6-81ba-c609ad4c4645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18598bd8c3bd4243aca6d18b2cae4e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:07Z,use_quota=True,user_id='96c0f55afb9e4189bcd0f3f1581ab08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452201ae-0f0a-4b90-a9f8-5b28c90692c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452201ae-0f0a-4b90-a9f8-5b28c90692c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec84c5b-63db-4f8d-abd9-b4ab7632a23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec84c5b-63db-4f8d-abd9-b4ab7632a23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc31ec7-2e5c-47b6-81ba-c609ad4c4645', 'volume_name': 'volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645', 'volume_size': 2}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e224dbf-c083-4088-b491-0c14bcdee900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e224dbf-c083-4088-b491-0c14bcdee900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c487917-6ed9-42a6-ae88-62048b7cca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:06 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Volume 7bc31ec7-2e5c-47b6-81ba-c609ad4c4645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645', 'volume_size': 2} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-387530535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc31ec7-2e5c-47b6-81ba-c609ad4c4645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18598bd8c3bd4243aca6d18b2cae4e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:07Z,use_quota=True,user_id='96c0f55afb9e4189bcd0f3f1581ab08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Creating volume 7bc31ec7-2e5c-47b6-81ba-c609ad4c4645 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:10:06 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:10:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645 2147483648 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:06 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645 2147483648 Sep 03 20:10:06 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:07 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645 2147483648" returned: 0 in 0.853s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:07 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645 Sep 03 20:10:07 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:07 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:INSERT=55,cinder:SELECT=143,cinder:UPDATE=189,cinder:DELETE=18 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:10:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Acquiring lock "cinder-quobyte-94850303-2c9f-4072-ada9-2524ce857a2b" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Lock "cinder-quobyte-94850303-2c9f-4072-ada9-2524ce857a2b" acquired by "delete_volume" :: waited 0.032s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:08 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea80349f-a924-4ddb-9b90-2a133a34110a]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-94850303-2c9f-4072-ada9-2524ce857a2b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:08 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645" returned: 0 in 0.491s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:10:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c487917-6ed9-42a6-ae88-62048b7cca30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645', 'volume_size': 2}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a57123c-a5cc-4315-ad2b-815577e988b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:08 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Volume volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645 (7bc31ec7-2e5c-47b6-81ba-c609ad4c4645): created successfully Sep 03 20:10:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a57123c-a5cc-4315-ad2b-815577e988b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Flow 'volume_create_manager' (7d3bcd4b-ac85-4951-a594-717bda1fc411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d98bb292-79c6-48e9-9c02-10d66c8d7d47 tempest-VolumesCloneNegativeTest-1799275110 None] Created volume successfully. Sep 03 20:10:08 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-94850303-2c9f-4072-ada9-2524ce857a2b Sep 03 20:10:08 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:08 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-94850303-2c9f-4072-ada9-2524ce857a2b" returned: 0 in 0.699s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-94850303-2c9f-4072-ada9-2524ce857a2b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:08 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-94850303-2c9f-4072-ada9-2524ce857a2b Sep 03 20:10:08 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Acquiring lock "cinder-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Lock "cinder-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:09 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-94850303-2c9f-4072-ada9-2524ce857a2b" returned: 0 in 0.434s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Acquiring lock "cinder-quobyte-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Lock "cinder-quobyte-94850303-2c9f-4072-ada9-2524ce857a2b" released by "delete_volume" :: held 1.235s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Acquiring lock "cinder-quobyte-b182e2a8-deb8-49d2-a838-529b8ee1e2ea" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Lock "cinder-quobyte-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645" acquired by "delete_volume" :: waited 0.037s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Lock "cinder-quobyte-b182e2a8-deb8-49d2-a838-529b8ee1e2ea" acquired by "delete_volume" :: waited 0.059s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d9ecd0-c6b6-495a-abc6-9b60b148b72e]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f1cca8-d85b-4b6b-8c54-64e25f1902d2]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:09 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea Sep 03 20:10:09 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:09 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645 Sep 03 20:10:09 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:09 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea" returned: 0 in 0.504s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:09 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea Sep 03 20:10:09 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:09 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645" returned: 0 in 0.617s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:10 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645 Sep 03 20:10:10 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:10 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b182e2a8-deb8-49d2-a838-529b8ee1e2ea" returned: 0 in 0.536s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Lock "cinder-quobyte-b182e2a8-deb8-49d2-a838-529b8ee1e2ea" released by "delete_volume" :: held 1.128s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:10 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645" returned: 0 in 0.576s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Lock "cinder-quobyte-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645" released by "delete_volume" :: held 1.319s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:10 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Created reservations ['b853682a-dbea-4c7d-aca4-867800d0a705'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:10 devstack cinder-volume[87582]: WARNING cinder.quota [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-346201616 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-346201616, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:10:10 devstack cinder-volume[87582]: WARNING cinder.quota [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-346201616 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-346201616, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:10:10 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Created reservations ['020eb210-a8e0-4d21-8dc5-fe5dbdd2872f', '17314b13-4d9d-4224-80b5-da281ab20aa1', 'd28220cc-402b-43dc-9ffd-805c0cf8bd3d', '796fb91d-5864-4c8a-9edc-3a23276844d4'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:10 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Created reservations ['a0b4fe5f-f8d7-494a-ad0c-375d9f288c47', 'a58d792e-1389-4d7e-88ad-8b8129157b9d', '4198fc5d-ccd1-4534-b24b-ed3d7ff0d1ff', '734e4335-acbd-4db5-8e46-2108c40c6118'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:11 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:10:11 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Created reservations ['c32f4bda-6243-4bb8-a989-7016517a4e86', '52b47290-97f4-4708-b455-8d60afa396b0', '73492471-91a8-4702-9982-2a25e6a18e7a', '96a7d7cd-7218-44e4-ac0f-b487c4690012'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:11 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.695s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:11 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:10:11 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:11 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Deleted volume successfully. Sep 03 20:10:11 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d1aeacea-e540-4c60-b8b9-b4e1ea7d4a5b tempest-VolumesCloneNegativeTest-1799275110 None] Lock "cinder-7bc31ec7-2e5c-47b6-81ba-c609ad4c4645-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:12 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.588s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:12 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:10:12 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7d4e5869-a17a-4b4b-b4c7-3374e149921c tempest-GroupsTest-1917888673 None] Delete group completed successfully. Sep 03 20:10:16 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Flow 'volume_create_manager' (74a239e4-3f84-4fe2-b800-ff56b02b7b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94486587-b8f6-40d3-ae0e-0c0dd69f5cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94486587-b8f6-40d3-ae0e-0c0dd69f5cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-961174205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317f5631-175d-4aea-8795-0128deb1a02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0607f41594b74c28aae5df457cde8dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:17Z,use_quota=True,user_id='24587630c38a4f45a46cc04609b023ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740e1773-9f0d-43e5-92e1-73f866fac5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740e1773-9f0d-43e5-92e1-73f866fac5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaab5d2-e1e9-4405-8701-ca69bd55bcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaab5d2-e1e9-4405-8701-ca69bd55bcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317f5631-175d-4aea-8795-0128deb1a02d', 'volume_name': 'volume-317f5631-175d-4aea-8795-0128deb1a02d', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f5d822-a234-4f50-ba32-6a5d3ce562d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f5d822-a234-4f50-ba32-6a5d3ce562d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af67f949-427b-4fe3-ab7f-84792968321d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:17 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Volume 317f5631-175d-4aea-8795-0128deb1a02d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317f5631-175d-4aea-8795-0128deb1a02d', 'volume_size': 1} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-961174205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317f5631-175d-4aea-8795-0128deb1a02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0607f41594b74c28aae5df457cde8dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:17Z,use_quota=True,user_id='24587630c38a4f45a46cc04609b023ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Creating volume 317f5631-175d-4aea-8795-0128deb1a02d {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:10:17 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:10:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-317f5631-175d-4aea-8795-0128deb1a02d 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:17 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-317f5631-175d-4aea-8795-0128deb1a02d 1073741824 Sep 03 20:10:17 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:18 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-317f5631-175d-4aea-8795-0128deb1a02d 1073741824" returned: 0 in 0.904s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-317f5631-175d-4aea-8795-0128deb1a02d {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:18 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-317f5631-175d-4aea-8795-0128deb1a02d Sep 03 20:10:18 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:18 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-317f5631-175d-4aea-8795-0128deb1a02d" returned: 0 in 0.487s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af67f949-427b-4fe3-ab7f-84792968321d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317f5631-175d-4aea-8795-0128deb1a02d', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95de200-5ec5-449a-90cf-917b2ec1efe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (e168d6cc-b62d-42e5-bfea-4f67026163ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c838b89-976d-4e32-a610-669bd6a9c8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c838b89-976d-4e32-a610-669bd6a9c8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-331415383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed4b5ef-e54f-4251-a10c-44524d30f57b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51fb409eed1f4f2ab02850eb9cc07546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:19Z,use_quota=True,user_id='faf2dfa7457245beb645c64f10e97a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a735202-a167-4673-bf19-e54a2f032183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a735202-a167-4673-bf19-e54a2f032183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121e6d98-7098-4dbe-a61c-c89c5869d847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121e6d98-7098-4dbe-a61c-c89c5869d847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed4b5ef-e54f-4251-a10c-44524d30f57b', 'volume_name': 'volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c8c71c-ba36-4b99-8754-f8bcfa0686f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c8c71c-ba36-4b99-8754-f8bcfa0686f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49099418-d2c2-4b87-b9d7-471ac174e87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:18 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Volume 0ed4b5ef-e54f-4251-a10c-44524d30f57b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b', 'volume_size': 1} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-331415383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed4b5ef-e54f-4251-a10c-44524d30f57b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51fb409eed1f4f2ab02850eb9cc07546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:19Z,use_quota=True,user_id='faf2dfa7457245beb645c64f10e97a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Creating volume 0ed4b5ef-e54f-4251-a10c-44524d30f57b {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:10:18 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:18 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Volume volume-317f5631-175d-4aea-8795-0128deb1a02d (317f5631-175d-4aea-8795-0128deb1a02d): created successfully Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95de200-5ec5-449a-90cf-917b2ec1efe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Flow 'volume_create_manager' (74a239e4-3f84-4fe2-b800-ff56b02b7b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:18 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b 1073741824 Sep 03 20:10:18 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:18 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9d953365-fc96-4571-92a2-c41b873825c1 tempest-TestMinimumBasicScenario-1053412317 None] Created volume successfully. Sep 03 20:10:19 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b 1073741824" returned: 0 in 0.902s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:19 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b Sep 03 20:10:19 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:20 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b" returned: 0 in 0.622s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:10:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49099418-d2c2-4b87-b9d7-471ac174e87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3c6192-ecd5-443a-a9b5-641e53be22b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:20 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Volume volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b (0ed4b5ef-e54f-4251-a10c-44524d30f57b): created successfully Sep 03 20:10:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3c6192-ecd5-443a-a9b5-641e53be22b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (e168d6cc-b62d-42e5-bfea-4f67026163ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:20 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c9db27d9-2253-44d2-888b-17cedfe421e1 tempest-VolumesGetTest-1017971280 None] Created volume successfully. Sep 03 20:10:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-4445b0ab-f180-46e9-a9f5-748a0e660a20 req-6c8d35af-5ce4-4e2b-bd8a-15c4886a5027 tempest-TestMinimumBasicScenario-1053412317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-4445b0ab-f180-46e9-a9f5-748a0e660a20 req-6c8d35af-5ce4-4e2b-bd8a-15c4886a5027 tempest-TestMinimumBasicScenario-1053412317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-4445b0ab-f180-46e9-a9f5-748a0e660a20 req-6c8d35af-5ce4-4e2b-bd8a-15c4886a5027 tempest-TestMinimumBasicScenario-1053412317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-4445b0ab-f180-46e9-a9f5-748a0e660a20 req-6c8d35af-5ce4-4e2b-bd8a-15c4886a5027 tempest-TestMinimumBasicScenario-1053412317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-317f5631-175d-4aea-8795-0128deb1a02d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8726c6f3-3133-40f4-afcc-6ef1ed384253', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:10:21 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-4445b0ab-f180-46e9-a9f5-748a0e660a20 req-6c8d35af-5ce4-4e2b-bd8a-15c4886a5027 tempest-TestMinimumBasicScenario-1053412317 None] attachment_update completed successfully. Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (3612b180-1cf0-4f13-a1a3-db4af08d8bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd578ae-f7d5-4a5b-b124-b3919fd4c6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd578ae-f7d5-4a5b-b124-b3919fd4c6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1295828538',display_name='tempest-VolumesGetTest-Volume-1561652741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286ef245-c2a4-468d-8747-6fdfc0e78dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fb409eed1f4f2ab02850eb9cc07546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:22Z,use_quota=True,user_id='faf2dfa7457245beb645c64f10e97a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f68cbd-7a3a-413f-9d99-8e0dce8cf63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f68cbd-7a3a-413f-9d99-8e0dce8cf63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4eb5735-b56f-4c56-a698-4d0b8c6df0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4eb5735-b56f-4c56-a698-4d0b8c6df0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286ef245-c2a4-468d-8747-6fdfc0e78dd9', 'volume_name': 'volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c3486e-c0ec-424d-9df3-5bb040f6e2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c3486e-c0ec-424d-9df3-5bb040f6e2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fa8675-1666-4acd-afe6-fd02f7429219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:22 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Volume 286ef245-c2a4-468d-8747-6fdfc0e78dd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9', 'volume_size': 1} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1295828538',display_name='tempest-VolumesGetTest-Volume-1561652741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286ef245-c2a4-468d-8747-6fdfc0e78dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fb409eed1f4f2ab02850eb9cc07546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:22Z,use_quota=True,user_id='faf2dfa7457245beb645c64f10e97a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Creating volume 286ef245-c2a4-468d-8747-6fdfc0e78dd9 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:10:22 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:10:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:22 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9 1073741824 Sep 03 20:10:22 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:23 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-cb5e85e2-2730-4230-ab3e-928029d4d8b4 tempest-GroupsV320Test-1842442387 None] Group tempest-GroupsV320Test-Group-640052276: creating Sep 03 20:10:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9 1073741824" returned: 0 in 1.053s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-cb5e85e2-2730-4230-ab3e-928029d4d8b4 tempest-GroupsV320Test-1842442387 None] Group tempest-GroupsV320Test-Group-640052276: created successfully Sep 03 20:10:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-cb5e85e2-2730-4230-ab3e-928029d4d8b4 tempest-GroupsV320Test-1842442387 None] Create group completed successfully. Sep 03 20:10:23 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9 Sep 03 20:10:23 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:24 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9" returned: 0 in 0.306s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:10:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fa8675-1666-4acd-afe6-fd02f7429219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2563bb-f8bd-456f-a58a-59caeecdd14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:24 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Volume volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9 (286ef245-c2a4-468d-8747-6fdfc0e78dd9): created successfully Sep 03 20:10:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2563bb-f8bd-456f-a58a-59caeecdd14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (3612b180-1cf0-4f13-a1a3-db4af08d8bd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:24 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c3a7e7e6-9abd-4881-99e5-dc344a46652a tempest-VolumesGetTest-1017971280 None] Created volume successfully. Sep 03 20:10:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-286ef245-c2a4-468d-8747-6fdfc0e78dd9-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Lock "cinder-286ef245-c2a4-468d-8747-6fdfc0e78dd9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-quobyte-286ef245-c2a4-468d-8747-6fdfc0e78dd9" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-286ef245-c2a4-468d-8747-6fdfc0e78dd9" acquired by "delete_volume" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:25 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e256845-f05e-47c1-8ffd-41cb252b8572]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:25 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9 Sep 03 20:10:25 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:25 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-8d8e599d-01ae-4360-8eaa-397ebd4b2b4e tempest-GroupsV320Test-1842442387 None] Created reservations ['2bf79472-53c1-4708-aacc-4f91fa856f36'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:25 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9" returned: 0 in 0.619s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:25 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9 Sep 03 20:10:25 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d8e599d-01ae-4360-8eaa-397ebd4b2b4e tempest-GroupsV320Test-1842442387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d8e599d-01ae-4360-8eaa-397ebd4b2b4e tempest-GroupsV320Test-1842442387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8d8e599d-01ae-4360-8eaa-397ebd4b2b4e tempest-GroupsV320Test-1842442387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8d8e599d-01ae-4360-8eaa-397ebd4b2b4e tempest-GroupsV320Test-1842442387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d8e599d-01ae-4360-8eaa-397ebd4b2b4e tempest-GroupsV320Test-1842442387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8d8e599d-01ae-4360-8eaa-397ebd4b2b4e tempest-GroupsV320Test-1842442387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:26 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:10:26 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:26 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-286ef245-c2a4-468d-8747-6fdfc0e78dd9" returned: 0 in 0.440s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-286ef245-c2a4-468d-8747-6fdfc0e78dd9" released by "delete_volume" :: held 1.138s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Created reservations ['a7d0603f-9396-4723-a97f-176b1788c1ec', 'b0fee036-d8e9-4bf4-a73b-2e3fb0e3f037', 'd88dc77c-48fd-44c6-9fb9-23a8000cc305', 'cf5bb528-df9b-477b-be7e-548aa0c20530'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:26 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8d8e599d-01ae-4360-8eaa-397ebd4b2b4e tempest-GroupsV320Test-1842442387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.546s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-8d8e599d-01ae-4360-8eaa-397ebd4b2b4e tempest-GroupsV320Test-1842442387 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:10:26 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8d8e599d-01ae-4360-8eaa-397ebd4b2b4e tempest-GroupsV320Test-1842442387 None] Delete group completed successfully. Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:26 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:10:26 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:26 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.278s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:10:26 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Deleted volume successfully. Sep 03 20:10:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-11e29f58-0f5f-45fd-8748-2ad2bea8b140 tempest-VolumesGetTest-1017971280 None] Lock "cinder-286ef245-c2a4-468d-8747-6fdfc0e78dd9-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-0ed4b5ef-e54f-4251-a10c-44524d30f57b-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Lock "cinder-0ed4b5ef-e54f-4251-a10c-44524d30f57b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-quobyte-0ed4b5ef-e54f-4251-a10c-44524d30f57b" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-0ed4b5ef-e54f-4251-a10c-44524d30f57b" acquired by "delete_volume" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:27 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[14768298-b534-49aa-a1ad-be106cd837e7]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:27 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b Sep 03 20:10:27 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:28 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b" returned: 0 in 0.538s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:28 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b Sep 03 20:10:28 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:28 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0ed4b5ef-e54f-4251-a10c-44524d30f57b" returned: 0 in 0.339s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-0ed4b5ef-e54f-4251-a10c-44524d30f57b" released by "delete_volume" :: held 0.953s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:28 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Created reservations ['c2501033-90f2-4629-aa19-9350a53abd04', '86265264-6b25-46fb-b4db-d01f93121fb2', '8c5e8e4b-f018-4e1e-859e-6e5b73204504', 'd9f4ac45-d2b6-4a7c-a991-3f64a191992c'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:28 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:10:28 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:29 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.315s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:29 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:10:29 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Deleted volume successfully. Sep 03 20:10:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a1102903-e35b-44e4-9539-4fbd4137147b tempest-VolumesGetTest-1017971280 None] Lock "cinder-0ed4b5ef-e54f-4251-a10c-44524d30f57b-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (7ea1854e-31e8-4156-92ec-bc0192dc1a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a80690-13f3-4684-9a27-4e29005a4b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a80690-13f3-4684-9a27-4e29005a4b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2115062675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41b9e8d-9501-4823-bb0e-8b4449c2c56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fb409eed1f4f2ab02850eb9cc07546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:30Z,use_quota=True,user_id='faf2dfa7457245beb645c64f10e97a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3c71fa-a362-420c-9a25-fa091021b2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3c71fa-a362-420c-9a25-fa091021b2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdb57e1-304f-47f8-baac-8678d34180ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdb57e1-304f-47f8-baac-8678d34180ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41b9e8d-9501-4823-bb0e-8b4449c2c56f', 'volume_name': 'volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea69417d-6051-4c56-a295-417e96b503e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea69417d-6051-4c56-a295-417e96b503e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b49c72-f05c-424c-a141-31de59c358d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:30 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Volume c41b9e8d-9501-4823-bb0e-8b4449c2c56f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f', 'volume_size': 1} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2115062675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41b9e8d-9501-4823-bb0e-8b4449c2c56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fb409eed1f4f2ab02850eb9cc07546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:30Z,use_quota=True,user_id='faf2dfa7457245beb645c64f10e97a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Creating volume c41b9e8d-9501-4823-bb0e-8b4449c2c56f {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:10:30 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:30 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f 1073741824 Sep 03 20:10:30 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Flow 'volume_create_manager' (f4a160b1-c37f-42f8-8b28-d11e6ac33f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e27ab9-6426-4808-9b25-1a1d02951639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e27ab9-6426-4808-9b25-1a1d02951639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2029362158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556ce307-320e-462e-80b7-b49baacb1185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36390022479647559e0b2eb8d76728a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:31Z,use_quota=True,user_id='acf951ac96324f3fa6fa57d8c9ea2b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a40b39-6fd4-47df-a47c-1e239868fdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a40b39-6fd4-47df-a47c-1e239868fdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c25763-74c2-486a-8eff-12485b1682f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c25763-74c2-486a-8eff-12485b1682f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '556ce307-320e-462e-80b7-b49baacb1185', 'volume_name': 'volume-556ce307-320e-462e-80b7-b49baacb1185', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb50802d-2337-4312-a9f4-4f3fd205e2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb50802d-2337-4312-a9f4-4f3fd205e2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c87260-ce7c-4bde-bda1-c9e9b9970fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:31 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Volume 556ce307-320e-462e-80b7-b49baacb1185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-556ce307-320e-462e-80b7-b49baacb1185', 'volume_size': 1} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:31 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f 1073741824" returned: 0 in 0.587s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:31 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f Sep 03 20:10:31 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:31 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f" returned: 0 in 0.325s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.391s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2029362158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556ce307-320e-462e-80b7-b49baacb1185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36390022479647559e0b2eb8d76728a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:31Z,use_quota=True,user_id='acf951ac96324f3fa6fa57d8c9ea2b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Creating volume 556ce307-320e-462e-80b7-b49baacb1185 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:10:31 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-556ce307-320e-462e-80b7-b49baacb1185 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b49c72-f05c-424c-a141-31de59c358d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47407d6-0850-4b26-a2bf-6e09743c1ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:31 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-556ce307-320e-462e-80b7-b49baacb1185 1073741824 Sep 03 20:10:31 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:31 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Volume volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f (c41b9e8d-9501-4823-bb0e-8b4449c2c56f): created successfully Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47407d6-0850-4b26-a2bf-6e09743c1ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (7ea1854e-31e8-4156-92ec-bc0192dc1a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:31 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f3b00e63-d5d5-41e0-8cfb-c3a7a51b8453 tempest-VolumesGetTest-1017971280 None] Created volume successfully. Sep 03 20:10:32 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-556ce307-320e-462e-80b7-b49baacb1185 1073741824" returned: 0 in 0.564s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-556ce307-320e-462e-80b7-b49baacb1185 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:32 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-556ce307-320e-462e-80b7-b49baacb1185 Sep 03 20:10:32 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:32 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-556ce307-320e-462e-80b7-b49baacb1185" returned: 0 in 0.344s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:10:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c87260-ce7c-4bde-bda1-c9e9b9970fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-556ce307-320e-462e-80b7-b49baacb1185', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20d11aa-75e6-439f-ba06-ef16c4335625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:32 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Volume volume-556ce307-320e-462e-80b7-b49baacb1185 (556ce307-320e-462e-80b7-b49baacb1185): created successfully Sep 03 20:10:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20d11aa-75e6-439f-ba06-ef16c4335625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Flow 'volume_create_manager' (f4a160b1-c37f-42f8-8b28-d11e6ac33f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:32 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d15dbda1-61ee-442d-8488-51e2b730b9bc tempest-AbsoluteLimitsTests-338795947 None] Created volume successfully. Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (11e86ad8-72f1-450d-8d57-aa978fb66e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9327fe-13cf-49c7-a3eb-a726bc44df30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9327fe-13cf-49c7-a3eb-a726bc44df30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1826287870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a7564f-7ed5-4d80-8685-679d03f11bd4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51fb409eed1f4f2ab02850eb9cc07546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c41b9e8d-9501-4823-bb0e-8b4449c2c56f,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:33Z,use_quota=True,user_id='faf2dfa7457245beb645c64f10e97a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0f6217-e36c-49e6-beeb-7cabcca2ec95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0f6217-e36c-49e6-beeb-7cabcca2ec95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48de20e4-9349-4f73-9779-42d7181bc047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Acquiring lock "cinder-556ce307-320e-462e-80b7-b49baacb1185-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48de20e4-9349-4f73-9779-42d7181bc047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '08a7564f-7ed5-4d80-8685-679d03f11bd4', 'volume_name': 'volume-08a7564f-7ed5-4d80-8685-679d03f11bd4', 'volume_size': 1, 'source_volid': 'c41b9e8d-9501-4823-bb0e-8b4449c2c56f', 'source_volstatus': 'available'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c75fd54-7f5e-4f0e-9ffe-7fe0d46a6f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c75fd54-7f5e-4f0e-9ffe-7fe0d46a6f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a5c7e4-4aad-43cb-9be3-f16125e6f51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:33 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Volume 08a7564f-7ed5-4d80-8685-679d03f11bd4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-08a7564f-7ed5-4d80-8685-679d03f11bd4', 'volume_size': 1, 'source_volid': 'c41b9e8d-9501-4823-bb0e-8b4449c2c56f', 'source_volstatus': 'available'} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Lock "cinder-556ce307-320e-462e-80b7-b49baacb1185-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:33 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Cloning volume c41b9e8d-9501-4823-bb0e-8b4449c2c56f to volume 08a7564f-7ed5-4d80-8685-679d03f11bd4 Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Acquiring lock "cinder-quobyte-556ce307-320e-462e-80b7-b49baacb1185" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Creating offline snapshot 9cc0fe8a-a088-4c61-a338-62e801feb16e of volume c41b9e8d-9501-4823-bb0e-8b4449c2c56f {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Lock "cinder-quobyte-556ce307-320e-462e-80b7-b49baacb1185" acquired by "delete_volume" :: waited 0.049s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[67918e34-1626-40f0-bc90-929f1225673e]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8502b111-f42a-4d96-b690-332af98af9d0]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-556ce307-320e-462e-80b7-b49baacb1185 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:33 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f Sep 03 20:10:33 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:33 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-556ce307-320e-462e-80b7-b49baacb1185 Sep 03 20:10:33 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:33 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f" returned: 0 in 0.455s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:33 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-556ce307-320e-462e-80b7-b49baacb1185" returned: 0 in 0.463s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-556ce307-320e-462e-80b7-b49baacb1185 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:33 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e 1G Sep 03 20:10:33 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:33 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-556ce307-320e-462e-80b7-b49baacb1185 Sep 03 20:10:33 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:34 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-556ce307-320e-462e-80b7-b49baacb1185" returned: 0 in 0.322s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Lock "cinder-quobyte-556ce307-320e-462e-80b7-b49baacb1185" released by "delete_volume" :: held 0.843s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Created reservations ['0a843d11-87b2-4b63-bd0c-44b1340e8f83', '6c8a1481-d71a-4e6b-962f-a9ac1b990560', 'bad99673-37fa-4747-b0bd-8eed650e9a16', '4f26e243-07cd-4ce2-b888-a61644d1f850'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:34 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:10:34 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:34 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e 1G" returned: 0 in 0.682s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:34 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e Sep 03 20:10:34 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:34 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.309s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:10:34 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Deleted volume successfully. Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f29d2d7f-fc2b-433e-9533-e2288308de26 tempest-AbsoluteLimitsTests-338795947 None] Lock "cinder-556ce307-320e-462e-80b7-b49baacb1185-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:34 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e" returned: 0 in 0.352s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:34 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e is being set with open permissions: ugo+rw Sep 03 20:10:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:34 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e Sep 03 20:10:34 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:35 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e" returned: 0 in 0.286s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:35 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.info Sep 03 20:10:35 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:35 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.info" returned: 0 in 0.294s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:35 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.info is being set with open permissions: ugo+rw Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:35 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.info Sep 03 20:10:35 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:35 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.info" returned: 0 in 0.343s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-quobyte-08a7564f-7ed5-4d80-8685-679d03f11bd4" by "_copy_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-08a7564f-7ed5-4d80-8685-679d03f11bd4" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] snapshot: 9cc0fe8a-a088-4c61-a338-62e801feb16e, volume: 08a7564f-7ed5-4d80-8685-679d03f11bd4, {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[930fc86b-f605-4923-80da-4c82cc796503]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:36 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e Sep 03 20:10:36 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:36 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e" returned: 0 in 0.509s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53ba47f-187f-40a1-8d65-daff47a8125d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:36 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f Sep 03 20:10:36 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:36 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:10:36 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:36 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f" returned: 0 in 0.541s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Creating direct copy from snapshot {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG cinder.utils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Path /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4 not found in is_blk_device check {{(pid=87582) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 20:10:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:37 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4 Sep 03 20:10:37 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:37 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.355s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:10:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:10:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 28 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:10:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:10:42 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4" returned: 0 in 5.786s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:42 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:10:42 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Converted 1024.00 MB image at 176.95 MB/s Sep 03 20:10:42 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4 is being set with open permissions: ugo+rw Sep 03 20:10:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:42 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4 Sep 03 20:10:42 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:43 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4" returned: 0 in 0.280s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-08a7564f-7ed5-4d80-8685-679d03f11bd4" released by "_copy_volume_from_snapshot" :: held 7.206s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-quobyte-9cc0fe8a-a088-4c61-a338-62e801feb16e" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-9cc0fe8a-a088-4c61-a338-62e801feb16e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Deleting offline snapshot 9cc0fe8a-a088-4c61-a338-62e801feb16e of volume c41b9e8d-9501-4823-bb0e-8b4449c2c56f {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:10:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] snapshot_file for this snap is: volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:10:43 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[316ec212-4eef-40a6-a6f8-10041622ffa1]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:43 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e Sep 03 20:10:43 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:43 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e" returned: 0 in 0.428s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:10:43 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac3b6ea-5b2b-4f30-a333-432b51873618]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:43 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f Sep 03 20:10:43 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:44 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f" returned: 0 in 0.607s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:44 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e Sep 03 20:10:44 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:44 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e" returned: 0 in 0.446s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:44 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e Sep 03 20:10:44 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:44 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f.9cc0fe8a-a088-4c61-a338-62e801feb16e" returned: 0 in 0.294s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-9cc0fe8a-a088-4c61-a338-62e801feb16e" released by "_delete_snapshot" :: held 1.911s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.823s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a5c7e4-4aad-43cb-9be3-f16125e6f51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a7564f-7ed5-4d80-8685-679d03f11bd4', 'volume_size': 1, 'source_volid': 'c41b9e8d-9501-4823-bb0e-8b4449c2c56f', 'source_volstatus': 'available'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4c8c44-1e76-4f54-8d6f-146cdab05142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:45 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Volume volume-08a7564f-7ed5-4d80-8685-679d03f11bd4 (08a7564f-7ed5-4d80-8685-679d03f11bd4): created successfully Sep 03 20:10:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4c8c44-1e76-4f54-8d6f-146cdab05142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (11e86ad8-72f1-450d-8d57-aa978fb66e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:45 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c3301cc6-84e9-4e4d-8adf-2bcdec58e0d1 tempest-VolumesGetTest-1017971280 None] Created volume successfully. Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Flow 'volume_create_manager' (9bea91df-5257-4930-9915-98f340f29411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58698dd3-76f0-4406-b832-5f140e8c0635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58698dd3-76f0-4406-b832-5f140e8c0635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-888433366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc90fc50-c2a6-48cf-8d2d-81191efa9ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a4f77f09c94c579caff77284623eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:46Z,use_quota=True,user_id='32ec2ce0c2d64b8fa07afa1967311496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1382bc07-650d-4a93-937b-2bc949b6de11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1382bc07-650d-4a93-937b-2bc949b6de11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191ee48d-b970-4d10-999e-330507848d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191ee48d-b970-4d10-999e-330507848d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc90fc50-c2a6-48cf-8d2d-81191efa9ee7', 'volume_name': 'volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0b23df-0dd9-4fe4-9ce6-85df291d5a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0b23df-0dd9-4fe4-9ce6-85df291d5a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6e287e-ae36-40ad-a215-a9675afc722c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:46 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Volume bc90fc50-c2a6-48cf-8d2d-81191efa9ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7', 'volume_size': 1} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-888433366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc90fc50-c2a6-48cf-8d2d-81191efa9ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a4f77f09c94c579caff77284623eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:46Z,use_quota=True,user_id='32ec2ce0c2d64b8fa07afa1967311496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Creating volume bc90fc50-c2a6-48cf-8d2d-81191efa9ee7 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:10:46 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:46 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7 1073741824 Sep 03 20:10:46 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (1ba1895b-2444-47cb-873b-b7ab8e08e877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae593ec-8edf-4052-ba80-7243c5c98b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae593ec-8edf-4052-ba80-7243c5c98b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1198711485',display_name='tempest-VolumesGetTest-Volume-1461304489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=447d81ba-e52e-4f48-88b9-6587e5a30b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fb409eed1f4f2ab02850eb9cc07546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:47Z,use_quota=True,user_id='faf2dfa7457245beb645c64f10e97a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e06fe4-62c3-4e90-8c03-6df041e32b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e06fe4-62c3-4e90-8c03-6df041e32b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c19d35-8d78-47bc-b844-0fd41677f582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c19d35-8d78-47bc-b844-0fd41677f582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '447d81ba-e52e-4f48-88b9-6587e5a30b69', 'volume_name': 'volume-447d81ba-e52e-4f48-88b9-6587e5a30b69', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4409f6c8-fed2-48f5-abc9-f647dde503b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4409f6c8-fed2-48f5-abc9-f647dde503b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7429b64e-7911-422c-bde8-821392e98079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:46 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Volume 447d81ba-e52e-4f48-88b9-6587e5a30b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-447d81ba-e52e-4f48-88b9-6587e5a30b69', 'volume_size': 1} Sep 03 20:10:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:47 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7 1073741824" returned: 0 in 0.632s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:47 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7 Sep 03 20:10:47 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:47 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7" returned: 0 in 0.292s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1198711485',display_name='tempest-VolumesGetTest-Volume-1461304489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=447d81ba-e52e-4f48-88b9-6587e5a30b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fb409eed1f4f2ab02850eb9cc07546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:47Z,use_quota=True,user_id='faf2dfa7457245beb645c64f10e97a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Creating volume 447d81ba-e52e-4f48-88b9-6587e5a30b69 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:10:47 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-447d81ba-e52e-4f48-88b9-6587e5a30b69 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6e287e-ae36-40ad-a215-a9675afc722c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4010653d-ca66-4d08-bcae-b022cacbe1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:47 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-447d81ba-e52e-4f48-88b9-6587e5a30b69 1073741824 Sep 03 20:10:47 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:47 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Volume volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7 (bc90fc50-c2a6-48cf-8d2d-81191efa9ee7): created successfully Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4010653d-ca66-4d08-bcae-b022cacbe1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Flow 'volume_create_manager' (9bea91df-5257-4930-9915-98f340f29411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-56e6dc9c-5f80-48f8-81a3-252d6d0a2b3e tempest-VolumesTransfersTest-1601410741 None] Created volume successfully. Sep 03 20:10:48 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-447d81ba-e52e-4f48-88b9-6587e5a30b69 1073741824" returned: 0 in 0.611s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-447d81ba-e52e-4f48-88b9-6587e5a30b69 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:48 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-447d81ba-e52e-4f48-88b9-6587e5a30b69 Sep 03 20:10:48 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:48 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-447d81ba-e52e-4f48-88b9-6587e5a30b69" returned: 0 in 0.276s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:10:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7429b64e-7911-422c-bde8-821392e98079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-447d81ba-e52e-4f48-88b9-6587e5a30b69', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38206483-be9d-4171-add0-9f013023b60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:48 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Volume volume-447d81ba-e52e-4f48-88b9-6587e5a30b69 (447d81ba-e52e-4f48-88b9-6587e5a30b69): created successfully Sep 03 20:10:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38206483-be9d-4171-add0-9f013023b60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (1ba1895b-2444-47cb-873b-b7ab8e08e877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b5b4f50d-2b01-4dd2-a937-612df331b1ae tempest-VolumesGetTest-1017971280 None] Created volume successfully. Sep 03 20:10:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-447d81ba-e52e-4f48-88b9-6587e5a30b69-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Lock "cinder-447d81ba-e52e-4f48-88b9-6587e5a30b69-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-quobyte-447d81ba-e52e-4f48-88b9-6587e5a30b69" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:49 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-48db8798-eea2-455a-a3fb-fb9104715da8 tempest-VolumesTransfersTest-478220937 None] Transfer volume completed successfully. Sep 03 20:10:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-447d81ba-e52e-4f48-88b9-6587e5a30b69" acquired by "delete_volume" :: waited 0.037s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:49 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8465f35b-0b46-4fab-a4a8-af8bb428648d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-447d81ba-e52e-4f48-88b9-6587e5a30b69 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:49 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-447d81ba-e52e-4f48-88b9-6587e5a30b69 Sep 03 20:10:49 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:49 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-447d81ba-e52e-4f48-88b9-6587e5a30b69" returned: 0 in 0.578s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-447d81ba-e52e-4f48-88b9-6587e5a30b69 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:49 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-447d81ba-e52e-4f48-88b9-6587e5a30b69 Sep 03 20:10:49 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Acquiring lock "cinder-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Lock "cinder-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Acquiring lock "cinder-quobyte-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Lock "cinder-quobyte-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc4c3cd-6d58-46ae-9b27-31607f8736d1]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:50 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-447d81ba-e52e-4f48-88b9-6587e5a30b69" returned: 0 in 0.336s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-447d81ba-e52e-4f48-88b9-6587e5a30b69" released by "delete_volume" :: held 0.999s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Created reservations ['449b95b0-1fd3-48e2-9b6d-d6f709489d43', 'afe60153-2ae1-4ebd-b234-c018a5643f7f', 'e27fdb23-f956-4bdc-a50b-644a89daaae0', 'af7a7739-fb90-4a5f-82a3-ef3f1d6c3a40'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:50 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7 Sep 03 20:10:50 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:50 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:10:50 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:50 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7" returned: 0 in 0.478s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:50 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7 Sep 03 20:10:50 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:50 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.314s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:10:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Deleted volume successfully. Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-473651e5-b900-4572-ae66-bb5d1dd48419 tempest-VolumesGetTest-1017971280 None] Lock "cinder-447d81ba-e52e-4f48-88b9-6587e5a30b69-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:50 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7" returned: 0 in 0.292s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Lock "cinder-quobyte-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7" released by "delete_volume" :: held 0.832s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:50 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Created reservations ['a38487ed-dbde-4192-b9a3-5de00b24216f', '3b9552a0-74a5-4da7-90b8-2c024ff3b007', '215ccd51-2734-43b6-8295-e88aed7e882b', '23c38598-9d1f-4677-a1b8-c10ffc0ac608'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:51 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:10:51 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:51 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.395s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:10:51 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Deleted volume successfully. Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a60f5450-440e-4810-9334-13805ecfe44f tempest-VolumesTransfersTest-425278439 None] Lock "cinder-bc90fc50-c2a6-48cf-8d2d-81191efa9ee7-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-08a7564f-7ed5-4d80-8685-679d03f11bd4-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Lock "cinder-08a7564f-7ed5-4d80-8685-679d03f11bd4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-quobyte-08a7564f-7ed5-4d80-8685-679d03f11bd4" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-08a7564f-7ed5-4d80-8685-679d03f11bd4" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ccc13b-32e0-4536-9dba-f2527554b7d1]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:51 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4 Sep 03 20:10:51 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Flow 'volume_create_manager' (69649040-7fd4-4714-b165-ee5f6c29f044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30618fe7-5363-40f3-a569-e20a2b37d8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30618fe7-5363-40f3-a569-e20a2b37d8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1946469866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977edfec-8a71-4e98-8f36-0b8129314f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a4f77f09c94c579caff77284623eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:52Z,use_quota=True,user_id='32ec2ce0c2d64b8fa07afa1967311496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e76cd29-980e-44d3-bc3f-2f5add770b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e76cd29-980e-44d3-bc3f-2f5add770b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0107566-0009-4743-be46-f36a1f67829a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0107566-0009-4743-be46-f36a1f67829a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '977edfec-8a71-4e98-8f36-0b8129314f96', 'volume_name': 'volume-977edfec-8a71-4e98-8f36-0b8129314f96', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ad0053-b453-4beb-8349-0c2ef77ec42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ad0053-b453-4beb-8349-0c2ef77ec42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38d5f13-9f62-445e-8729-c9a67b5f310d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:52 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Volume 977edfec-8a71-4e98-8f36-0b8129314f96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-977edfec-8a71-4e98-8f36-0b8129314f96', 'volume_size': 1} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1946469866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977edfec-8a71-4e98-8f36-0b8129314f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a4f77f09c94c579caff77284623eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:52Z,use_quota=True,user_id='32ec2ce0c2d64b8fa07afa1967311496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Creating volume 977edfec-8a71-4e98-8f36-0b8129314f96 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:10:52 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-977edfec-8a71-4e98-8f36-0b8129314f96 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:52 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:52 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-977edfec-8a71-4e98-8f36-0b8129314f96 1073741824 Sep 03 20:10:52 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4" returned: 0 in 0.497s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:52 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4 Sep 03 20:10:52 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:52 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-08a7564f-7ed5-4d80-8685-679d03f11bd4" returned: 0 in 0.375s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-08a7564f-7ed5-4d80-8685-679d03f11bd4" released by "delete_volume" :: held 0.953s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Created reservations ['9021dbde-4abc-4594-959d-c8fe2d71f887', '1cdf15f8-492b-48e5-91e2-e9f3a9940654', 'a70064c5-fb9f-44fe-bd41-ceb64832afa7', '539cdde2-9813-479c-ac9a-9b8ea29ce4a0'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:52 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-977edfec-8a71-4e98-8f36-0b8129314f96 1073741824" returned: 0 in 0.598s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-977edfec-8a71-4e98-8f36-0b8129314f96 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:52 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:10:52 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:52 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-977edfec-8a71-4e98-8f36-0b8129314f96 Sep 03 20:10:52 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:53 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.300s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:53 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:10:53 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Deleted volume successfully. Sep 03 20:10:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b95fa806-db53-4505-ae9e-3e43fe5d4ef5 tempest-VolumesGetTest-1017971280 None] Lock "cinder-08a7564f-7ed5-4d80-8685-679d03f11bd4-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:53 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-977edfec-8a71-4e98-8f36-0b8129314f96" returned: 0 in 0.385s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:10:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:53 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38d5f13-9f62-445e-8729-c9a67b5f310d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-977edfec-8a71-4e98-8f36-0b8129314f96', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:53 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53729f3-0f71-48a5-bc50-9749324a4423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:53 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Volume volume-977edfec-8a71-4e98-8f36-0b8129314f96 (977edfec-8a71-4e98-8f36-0b8129314f96): created successfully Sep 03 20:10:53 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53729f3-0f71-48a5-bc50-9749324a4423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:53 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Flow 'volume_create_manager' (69649040-7fd4-4714-b165-ee5f6c29f044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:53 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c9eeb806-b9bc-4487-a09c-890cd0543ddd tempest-VolumesTransfersTest-1601410741 None] Created volume successfully. Sep 03 20:10:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-c41b9e8d-9501-4823-bb0e-8b4449c2c56f-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Lock "cinder-c41b9e8d-9501-4823-bb0e-8b4449c2c56f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-quobyte-c41b9e8d-9501-4823-bb0e-8b4449c2c56f" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-c41b9e8d-9501-4823-bb0e-8b4449c2c56f" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:54 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cee96b-57fa-47a1-b238-910920a093f8]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:54 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f Sep 03 20:10:54 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Acquiring lock "cinder-977edfec-8a71-4e98-8f36-0b8129314f96-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Lock "cinder-977edfec-8a71-4e98-8f36-0b8129314f96-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:54 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f" returned: 0 in 0.622s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Acquiring lock "cinder-quobyte-977edfec-8a71-4e98-8f36-0b8129314f96" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:10:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Lock "cinder-quobyte-977edfec-8a71-4e98-8f36-0b8129314f96" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:10:54 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f Sep 03 20:10:54 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:54 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[654156b6-8faa-47a2-bdcd-7f547f8472d8]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-977edfec-8a71-4e98-8f36-0b8129314f96 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:54 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-977edfec-8a71-4e98-8f36-0b8129314f96 Sep 03 20:10:54 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:55 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c41b9e8d-9501-4823-bb0e-8b4449c2c56f" returned: 0 in 0.344s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-c41b9e8d-9501-4823-bb0e-8b4449c2c56f" released by "delete_volume" :: held 1.069s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Created reservations ['8f544b90-3d6e-48f5-9543-3e4302a702d2', '294813e7-cd55-4e11-a992-f005cdc8f48c', 'f6aa5547-7d2a-4a49-9598-53de13cae0a5', 'b47356dd-51bd-418c-a39c-23118877425b'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:55 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-977edfec-8a71-4e98-8f36-0b8129314f96" returned: 0 in 0.460s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-977edfec-8a71-4e98-8f36-0b8129314f96 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:55 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-977edfec-8a71-4e98-8f36-0b8129314f96 Sep 03 20:10:55 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:55 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:10:55 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:55 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.339s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:55 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-977edfec-8a71-4e98-8f36-0b8129314f96" returned: 0 in 0.428s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:55 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Deleted volume successfully. Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Lock "cinder-quobyte-977edfec-8a71-4e98-8f36-0b8129314f96" released by "delete_volume" :: held 0.958s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf60a478-6b4e-413b-b534-12af4b143b56 tempest-VolumesGetTest-1017971280 None] Lock "cinder-c41b9e8d-9501-4823-bb0e-8b4449c2c56f-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Created reservations ['4d88f8e7-d9d6-4173-8bca-01722a8f4021', 'e8ad1c66-0a03-42cc-9af8-8467e16ee554', '03130f38-2bbf-406c-9811-eb085ff5eb9a', '03711005-b474-404e-9c77-f5c19f1010c4'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:55 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:10:55 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:56 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.288s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:56 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:10:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Deleted volume successfully. Sep 03 20:10:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b8025914-5f6d-4d98-b873-36d606466462 tempest-VolumesTransfersTest-425278439 None] Lock "cinder-977edfec-8a71-4e98-8f36-0b8129314f96-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:10:57 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:10:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (229491dd-a411-40a3-a133-1c6fc71baa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:10:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b50a73-8e06-41c1-8eb4-bbf74e34346f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b50a73-8e06-41c1-8eb4-bbf74e34346f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-989305226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217b689e-0a88-4455-9485-7efb6b0d88aa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51fb409eed1f4f2ab02850eb9cc07546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:57Z,use_quota=True,user_id='faf2dfa7457245beb645c64f10e97a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff0c09f-b93f-4136-956c-a6d284016064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff0c09f-b93f-4136-956c-a6d284016064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9b47a7-3de8-4aff-bcc7-1dae7e05da6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:57 devstack cinder-volume[87582]: DEBUG cinder.image.glance [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Creating Keystone auth plugin from conf {{(pid=87582) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 20:10:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9b47a7-3de8-4aff-bcc7-1dae7e05da6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '217b689e-0a88-4455-9485-7efb6b0d88aa', 'volume_name': 'volume-217b689e-0a88-4455-9485-7efb6b0d88aa', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7143ce37-4c59-4c30-a7db-12a7aebbd989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7143ce37-4c59-4c30-a7db-12a7aebbd989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:10:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d98979-c460-4aa1-aa72-ad031742f639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:10:58 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Volume 217b689e-0a88-4455-9485-7efb6b0d88aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-217b689e-0a88-4455-9485-7efb6b0d88aa', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 20:10:58 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Trying to clone 217b689e-0a88-4455-9485-7efb6b0d88aa from image 2f677e69-c223-4c71-b630-2245f346f65e at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]). {{(pid=87582) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 20:10:58 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 20:10:58 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Image download 20.69 MB at 20.69 MB/s Sep 03 20:10:58 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0571aa0e-89c3-4107-81cd-b9c9dd1a80f9]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:59 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD Sep 03 20:10:59 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:59 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Temporary image 2f677e69-c223-4c71-b630-2245f346f65e is fetched for user faf2dfa7457245beb645c64f10e97a19. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2ae6b5-4b64-47d8-be61-3fbfd256b510]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:59 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD Sep 03 20:10:59 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:10:59 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-989305226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217b689e-0a88-4455-9485-7efb6b0d88aa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51fb409eed1f4f2ab02850eb9cc07546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:10:57Z,use_quota=True,user_id='faf2dfa7457245beb645c64f10e97a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Creating volume 217b689e-0a88-4455-9485-7efb6b0d88aa {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:10:59 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:10:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:10:59 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa 1073741824 Sep 03 20:10:59 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:00 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa 1073741824" returned: 0 in 0.529s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:00 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa Sep 03 20:11:00 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:00 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa" returned: 0 in 0.296s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:11:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:00 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Attempting download of 2f677e69-c223-4c71-b630-2245f346f65e ((None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}])) to volume 217b689e-0a88-4455-9485-7efb6b0d88aa. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 20:11:00 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6c2ce0-618d-4b3e-930a-b7ad2f0dfd5c]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_4uh26zsj {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:00 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_4uh26zsj Sep 03 20:11:00 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:01 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_4uh26zsj" returned: 0 in 0.361s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_4uh26zsj {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:01 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_4uh26zsj Sep 03 20:11:01 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:01 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_4uh26zsj" returned: 1 in 0.442s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_4uh26zsj' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:11:01 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1caf265-40a7-4551-b4b3-9b8184f059b9]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:01 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD Sep 03 20:11:01 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:01 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:01 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] 2f677e69-c223-4c71-b630-2245f346f65e was qcow2, converting to qcow2 {{(pid=87582) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 20:11:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:02 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa Sep 03 20:11:02 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=97,cinder:UPDATE=138,cinder:DELETE=12,cinder:INSERT=25 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Flow 'volume_create_manager' (ca0ec3e5-6a7c-4266-a59a-e8418769fa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764dc691-b949-4b8a-b3c0-fd01b20f6b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764dc691-b949-4b8a-b3c0-fd01b20f6b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1118697074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68cd9bf4-c105-4cac-9b04-9cef00c89ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8862236c92343c98f8a231450168a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:03Z,use_quota=True,user_id='9d63f2c2c8c4450abe82e0b5f759c94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03130841-52a1-46d8-9b5d-939f49368595),volume_type_id=03130841-52a1-46d8-9b5d-939f49368595)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559e8846-383c-47c5-a36f-d2567435e409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559e8846-383c-47c5-a36f-d2567435e409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d76b28-8543-4263-abc5-e9851357e91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d76b28-8543-4263-abc5-e9851357e91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68cd9bf4-c105-4cac-9b04-9cef00c89ee1', 'volume_name': 'volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8f18ef-765e-483d-89b3-53f8abde1e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8f18ef-765e-483d-89b3-53f8abde1e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c8f01e-4d7f-4bb2-989d-7095e4297fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:03 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Volume 68cd9bf4-c105-4cac-9b04-9cef00c89ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1', 'volume_size': 1} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1118697074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68cd9bf4-c105-4cac-9b04-9cef00c89ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8862236c92343c98f8a231450168a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:03Z,use_quota=True,user_id='9d63f2c2c8c4450abe82e0b5f759c94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03130841-52a1-46d8-9b5d-939f49368595),volume_type_id=03130841-52a1-46d8-9b5d-939f49368595)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Creating volume 68cd9bf4-c105-4cac-9b04-9cef00c89ee1 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:11:03 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:03 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1 1073741824 Sep 03 20:11:03 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:03 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1 1073741824" returned: 0 in 0.585s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:03 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1 Sep 03 20:11:03 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:04 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa" returned: 0 in 2.081s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_j_i9a_4kdevstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:11:04 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Converted 112.00 MB image at 53.78 MB/s Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:04 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa 1G Sep 03 20:11:04 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:04 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1" returned: 0 in 0.313s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c8f01e-4d7f-4bb2-989d-7095e4297fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feaa4eaf-3be5-42e2-8fa8-09c4b0600c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:04 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Volume volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1 (68cd9bf4-c105-4cac-9b04-9cef00c89ee1): created successfully Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feaa4eaf-3be5-42e2-8fa8-09c4b0600c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Flow 'volume_create_manager' (ca0ec3e5-6a7c-4266-a59a-e8418769fa7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:04 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c2d90b03-c20d-4d97-8f4a-99c3e01fcd53 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Created volume successfully. Sep 03 20:11:04 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa 1G" returned: 0 in 0.338s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Downloaded image 2f677e69-c223-4c71-b630-2245f346f65e ((None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}])) to volume 217b689e-0a88-4455-9485-7efb6b0d88aa successfully. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Temporary image 2f677e69-c223-4c71-b630-2245f346f65e for user faf2dfa7457245beb645c64f10e97a19 is deleted. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Marking volume 217b689e-0a88-4455-9485-7efb6b0d88aa as bootable. {{(pid=87582) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Copying metadata from image 2f677e69-c223-4c71-b630-2245f346f65e to 217b689e-0a88-4455-9485-7efb6b0d88aa. {{(pid=87582) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Creating volume glance metadata for volume 217b689e-0a88-4455-9485-7efb6b0d88aa backed by image 2f677e69-c223-4c71-b630-2245f346f65e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87582) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d98979-c460-4aa1-aa72-ad031742f639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-217b689e-0a88-4455-9485-7efb6b0d88aa', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3199c174-1140-41ea-98c6-ae66bf2aca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:04 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Volume volume-217b689e-0a88-4455-9485-7efb6b0d88aa (217b689e-0a88-4455-9485-7efb6b0d88aa): created successfully Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3199c174-1140-41ea-98c6-ae66bf2aca30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (229491dd-a411-40a3-a133-1c6fc71baa4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:04 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b500cea8-9e56-47ed-8753-481239fb6203 tempest-VolumesGetTest-1017971280 None] Created volume successfully. Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (3fa8d4d9-b124-49b6-8bdb-8c2de1d55cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65642740-2f5a-4ab7-801c-21aca3755566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65642740-2f5a-4ab7-801c-21aca3755566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1243073990',display_name='tempest-VolumesGetTest-Volume-483241079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8923d996-0507-4e27-97e0-605e80f3514c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fb409eed1f4f2ab02850eb9cc07546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:05Z,use_quota=True,user_id='faf2dfa7457245beb645c64f10e97a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ac6169-26b3-4dce-a3fe-f776d19f7869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ac6169-26b3-4dce-a3fe-f776d19f7869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2863e5cd-d6f6-48ec-89e2-5567407d9d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2863e5cd-d6f6-48ec-89e2-5567407d9d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8923d996-0507-4e27-97e0-605e80f3514c', 'volume_name': 'volume-8923d996-0507-4e27-97e0-605e80f3514c', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fa2964-8ec4-4433-a7a0-f3ed6174211c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fa2964-8ec4-4433-a7a0-f3ed6174211c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca661c2e-aaee-4b4e-9482-914ec202bfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:05 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Volume 8923d996-0507-4e27-97e0-605e80f3514c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8923d996-0507-4e27-97e0-605e80f3514c', 'volume_size': 1} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1243073990',display_name='tempest-VolumesGetTest-Volume-483241079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8923d996-0507-4e27-97e0-605e80f3514c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fb409eed1f4f2ab02850eb9cc07546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:05Z,use_quota=True,user_id='faf2dfa7457245beb645c64f10e97a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Creating volume 8923d996-0507-4e27-97e0-605e80f3514c {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:11:05 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8923d996-0507-4e27-97e0-605e80f3514c 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:05 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8923d996-0507-4e27-97e0-605e80f3514c 1073741824 Sep 03 20:11:05 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Flow 'volume_create_manager' (28898492-273c-4983-bc3c-7e1aa260cc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04adbb7-4193-4dc4-acd1-7681a51796b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04adbb7-4193-4dc4-acd1-7681a51796b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-837542038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049911b3-2d19-45b2-8dc1-bad9a3790572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f68488e59941aba2f44ca39d7ed467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:06Z,use_quota=True,user_id='3089e5cb412c4d98a2573f0ddb80281a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f78d5ca-dde6-4657-9a21-9175a3df7aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f78d5ca-dde6-4657-9a21-9175a3df7aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8357fb-447b-458a-b51a-ffb88d4a0d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8357fb-447b-458a-b51a-ffb88d4a0d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049911b3-2d19-45b2-8dc1-bad9a3790572', 'volume_name': 'volume-049911b3-2d19-45b2-8dc1-bad9a3790572', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67294d1-fcb1-472e-907a-08f1f54cf83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67294d1-fcb1-472e-907a-08f1f54cf83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2c6a83-0ec4-4e25-92a3-d53eed303da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:05 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Volume 049911b3-2d19-45b2-8dc1-bad9a3790572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049911b3-2d19-45b2-8dc1-bad9a3790572', 'volume_size': 1} Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:05 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8923d996-0507-4e27-97e0-605e80f3514c 1073741824" returned: 0 in 0.463s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8923d996-0507-4e27-97e0-605e80f3514c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:06 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8923d996-0507-4e27-97e0-605e80f3514c Sep 03 20:11:06 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ff00820e-66a2-41cf-8fda-625a9604c1c7 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ff00820e-66a2-41cf-8fda-625a9604c1c7 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ff00820e-66a2-41cf-8fda-625a9604c1c7 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ff00820e-66a2-41cf-8fda-625a9604c1c7 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ff00820e-66a2-41cf-8fda-625a9604c1c7 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ff00820e-66a2-41cf-8fda-625a9604c1c7 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:06 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:11:06 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:06 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8923d996-0507-4e27-97e0-605e80f3514c" returned: 0 in 0.248s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.306s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-837542038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049911b3-2d19-45b2-8dc1-bad9a3790572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f68488e59941aba2f44ca39d7ed467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:06Z,use_quota=True,user_id='3089e5cb412c4d98a2573f0ddb80281a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Creating volume 049911b3-2d19-45b2-8dc1-bad9a3790572 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:11:06 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-049911b3-2d19-45b2-8dc1-bad9a3790572 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca661c2e-aaee-4b4e-9482-914ec202bfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8923d996-0507-4e27-97e0-605e80f3514c', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27233b07-110e-4158-9acd-ac31d37f06be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:06 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-049911b3-2d19-45b2-8dc1-bad9a3790572 1073741824 Sep 03 20:11:06 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:06 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Volume volume-8923d996-0507-4e27-97e0-605e80f3514c (8923d996-0507-4e27-97e0-605e80f3514c): created successfully Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27233b07-110e-4158-9acd-ac31d37f06be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:06 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Flow 'volume_create_manager' (3fa8d4d9-b124-49b6-8bdb-8c2de1d55cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ff00820e-66a2-41cf-8fda-625a9604c1c7 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.296s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-ff00820e-66a2-41cf-8fda-625a9604c1c7 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:11:06 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ff00820e-66a2-41cf-8fda-625a9604c1c7 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Retype volume completed successfully. Sep 03 20:11:06 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8b45a653-c729-42a7-9442-9115b7a86ddf tempest-VolumesGetTest-1017971280 None] Created volume successfully. Sep 03 20:11:06 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-049911b3-2d19-45b2-8dc1-bad9a3790572 1073741824" returned: 0 in 0.481s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-049911b3-2d19-45b2-8dc1-bad9a3790572 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:06 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-049911b3-2d19-45b2-8dc1-bad9a3790572 Sep 03 20:11:06 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:07 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Acquiring lock "cinder-68cd9bf4-c105-4cac-9b04-9cef00c89ee1-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-049911b3-2d19-45b2-8dc1-bad9a3790572" returned: 0 in 0.278s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2c6a83-0ec4-4e25-92a3-d53eed303da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049911b3-2d19-45b2-8dc1-bad9a3790572', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5eaa13-993c-4764-9162-fc2004a01319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Lock "cinder-68cd9bf4-c105-4cac-9b04-9cef00c89ee1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:07 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Volume volume-049911b3-2d19-45b2-8dc1-bad9a3790572 (049911b3-2d19-45b2-8dc1-bad9a3790572): created successfully Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5eaa13-993c-4764-9162-fc2004a01319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Flow 'volume_create_manager' (28898492-273c-4983-bc3c-7e1aa260cc52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:07 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a88b1b54-2615-4d80-b2f4-a344ca182bff tempest-VolumesTransfersV357Test-875225632 None] Created volume successfully. Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Acquiring lock "cinder-quobyte-68cd9bf4-c105-4cac-9b04-9cef00c89ee1" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Lock "cinder-quobyte-68cd9bf4-c105-4cac-9b04-9cef00c89ee1" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e383e5a6-8ab2-45a0-a247-df5acd672bf1]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:07 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1 Sep 03 20:11:07 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:07 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1" returned: 0 in 0.410s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:07 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1 Sep 03 20:11:07 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-8923d996-0507-4e27-97e0-605e80f3514c-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Lock "cinder-8923d996-0507-4e27-97e0-605e80f3514c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-quobyte-8923d996-0507-4e27-97e0-605e80f3514c" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-8923d996-0507-4e27-97e0-605e80f3514c" acquired by "delete_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06e45f6-99fb-4d1d-85e5-cca95dba2516]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8923d996-0507-4e27-97e0-605e80f3514c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:07 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68cd9bf4-c105-4cac-9b04-9cef00c89ee1" returned: 0 in 0.338s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Lock "cinder-quobyte-68cd9bf4-c105-4cac-9b04-9cef00c89ee1" released by "delete_volume" :: held 0.806s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:08 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8923d996-0507-4e27-97e0-605e80f3514c Sep 03 20:11:08 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:08 devstack cinder-volume[87582]: WARNING cinder.quota [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:11:08 devstack cinder-volume[87582]: WARNING cinder.quota [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:UPDATE=142,cinder:SELECT=121,cinder:INSERT=44,cinder:DELETE=11 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Created reservations ['8d67cc8b-82e4-4008-97af-c30115ca5ec8', 'd11ac850-a19e-4c45-9131-6fb1f2d2f419', '95cc356d-6bee-40c5-8972-0f1e63b8616b', '763cc404-0efd-44aa-b817-1920449803e8'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:08 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:11:08 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:08 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8923d996-0507-4e27-97e0-605e80f3514c" returned: 0 in 0.529s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8923d996-0507-4e27-97e0-605e80f3514c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:08 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8923d996-0507-4e27-97e0-605e80f3514c Sep 03 20:11:08 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:08 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.396s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:11:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Deleted volume successfully. Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d4d3ff87-0117-4284-806d-d2698f0a7684 tempest-VolumeRetypeWithoutMigrationTest-2029518975 None] Lock "cinder-68cd9bf4-c105-4cac-9b04-9cef00c89ee1-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f645a526-c992-4319-ac75-c901801671f3 tempest-VolumesTransfersV357Test-561943994 None] Transfer volume completed successfully. Sep 03 20:11:08 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8923d996-0507-4e27-97e0-605e80f3514c" returned: 0 in 0.402s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-8923d996-0507-4e27-97e0-605e80f3514c" released by "delete_volume" :: held 0.997s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Created reservations ['2b9c455d-eefa-4319-97d7-e93a51e3387f', '49bf508b-ec5b-4593-beb5-3f89924fff5b', '2849c4d5-f0d3-42b8-bfde-cb5dffc533ba', '9ff585d4-5d64-46dc-9a03-61ad96fc6752'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:09 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:11:09 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:09 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.319s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:09 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:11:09 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Deleted volume successfully. Sep 03 20:11:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9dad79b3-b315-4db6-a852-2ddabac2f230 tempest-VolumesGetTest-1017971280 None] Lock "cinder-8923d996-0507-4e27-97e0-605e80f3514c-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Acquiring lock "cinder-049911b3-2d19-45b2-8dc1-bad9a3790572-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Lock "cinder-049911b3-2d19-45b2-8dc1-bad9a3790572-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Acquiring lock "cinder-quobyte-049911b3-2d19-45b2-8dc1-bad9a3790572" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Lock "cinder-quobyte-049911b3-2d19-45b2-8dc1-bad9a3790572" acquired by "delete_volume" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:09 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6695264-afa7-41b2-80d6-5f6b14127269]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-049911b3-2d19-45b2-8dc1-bad9a3790572 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:09 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-049911b3-2d19-45b2-8dc1-bad9a3790572 Sep 03 20:11:09 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:09 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-049911b3-2d19-45b2-8dc1-bad9a3790572" returned: 0 in 0.390s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-049911b3-2d19-45b2-8dc1-bad9a3790572 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:09 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-049911b3-2d19-45b2-8dc1-bad9a3790572 Sep 03 20:11:09 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-217b689e-0a88-4455-9485-7efb6b0d88aa-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Lock "cinder-217b689e-0a88-4455-9485-7efb6b0d88aa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Acquiring lock "cinder-quobyte-217b689e-0a88-4455-9485-7efb6b0d88aa" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-217b689e-0a88-4455-9485-7efb6b0d88aa" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:10 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc851347-fccc-455a-869d-333ea5aef26f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-049911b3-2d19-45b2-8dc1-bad9a3790572" returned: 0 in 0.292s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Lock "cinder-quobyte-049911b3-2d19-45b2-8dc1-bad9a3790572" released by "delete_volume" :: held 0.730s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Created reservations ['0c24bb77-5f62-4998-b324-5b9d3d1e8984', '985d4826-008e-4761-ac42-46828eb9d5f4', '725de06f-ff7c-499f-8a6c-4979d01317dd', '433d1ec7-ef84-4921-8bcd-ee625da1c0ad'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:11:10 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa Sep 03 20:11:10 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:10 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:11:10 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:10 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa" returned: 0 in 0.424s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:10 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa Sep 03 20:11:10 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:10 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.329s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:11:10 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Deleted volume successfully. Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcde7dc-8abb-4137-9602-ed4f3d43c93a tempest-VolumesTransfersV357Test-198854956 None] Lock "cinder-049911b3-2d19-45b2-8dc1-bad9a3790572-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:10 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-217b689e-0a88-4455-9485-7efb6b0d88aa" returned: 0 in 0.330s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Lock "cinder-quobyte-217b689e-0a88-4455-9485-7efb6b0d88aa" released by "delete_volume" :: held 0.811s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Created reservations ['44dbbad8-d759-4e56-a8c8-35666305c142', '51badef5-8258-4ab0-8551-2c7789fd1ead', 'd1601d76-e631-4317-a837-51a0e95e69e0', '40deb166-acf3-44c2-a3b1-7559aa3c698e'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:11 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:11:11 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Flow 'volume_create_manager' (06c6a9b3-edda-49f1-95a4-9694bcdacddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10a53de-f683-4771-8498-32845bd67b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10a53de-f683-4771-8498-32845bd67b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-936854729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9bfda4-2d5c-4892-9b20-17ad213ee880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f68488e59941aba2f44ca39d7ed467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:11Z,use_quota=True,user_id='3089e5cb412c4d98a2573f0ddb80281a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9823b4-2251-46d3-b8cf-75955d6b05e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9823b4-2251-46d3-b8cf-75955d6b05e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2cfda2b-56a3-4a13-bd7b-a9229dae4273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2cfda2b-56a3-4a13-bd7b-a9229dae4273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c9bfda4-2d5c-4892-9b20-17ad213ee880', 'volume_name': 'volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d0c979-7b70-4430-80ed-95cadfecaa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d0c979-7b70-4430-80ed-95cadfecaa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35341950-207a-48af-98bb-b38d7e836f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:11 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Volume 5c9bfda4-2d5c-4892-9b20-17ad213ee880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880', 'volume_size': 1} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-936854729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9bfda4-2d5c-4892-9b20-17ad213ee880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f68488e59941aba2f44ca39d7ed467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:11Z,use_quota=True,user_id='3089e5cb412c4d98a2573f0ddb80281a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Creating volume 5c9bfda4-2d5c-4892-9b20-17ad213ee880 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:11:11 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:11 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.317s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:11:11 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Deleted volume successfully. Sep 03 20:11:11 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880 1073741824 Sep 03 20:11:11 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-11d17a38-688c-4245-8ea7-8859fb2912e7 tempest-VolumesGetTest-1017971280 None] Lock "cinder-217b689e-0a88-4455-9485-7efb6b0d88aa-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:11 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880 1073741824" returned: 0 in 0.527s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:12 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880 Sep 03 20:11:12 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:12 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880" returned: 0 in 0.310s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:11:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35341950-207a-48af-98bb-b38d7e836f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79b6b32-cf7b-4269-9421-82f753f0f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:12 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Volume volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880 (5c9bfda4-2d5c-4892-9b20-17ad213ee880): created successfully Sep 03 20:11:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79b6b32-cf7b-4269-9421-82f753f0f816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Flow 'volume_create_manager' (06c6a9b3-edda-49f1-95a4-9694bcdacddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:12 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d42bcff9-0498-4618-90ca-2a3a644a0cb4 tempest-VolumesTransfersV357Test-875225632 None] Created volume successfully. Sep 03 20:11:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Acquiring lock "cinder-5c9bfda4-2d5c-4892-9b20-17ad213ee880-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Lock "cinder-5c9bfda4-2d5c-4892-9b20-17ad213ee880-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Acquiring lock "cinder-quobyte-5c9bfda4-2d5c-4892-9b20-17ad213ee880" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Lock "cinder-quobyte-5c9bfda4-2d5c-4892-9b20-17ad213ee880" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:13 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[af92c5a8-e2ef-4630-b056-98651f338cd9]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:13 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880 Sep 03 20:11:13 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:14 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880" returned: 0 in 0.401s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:14 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880 Sep 03 20:11:14 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:14 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5c9bfda4-2d5c-4892-9b20-17ad213ee880" returned: 0 in 0.265s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Lock "cinder-quobyte-5c9bfda4-2d5c-4892-9b20-17ad213ee880" released by "delete_volume" :: held 0.722s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:14 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Created reservations ['9cd6d6b3-3d17-41ae-b1c3-53a7021124b3', '63a3145c-95aa-4f81-bb33-83a922d5c371', '84e7045d-09f8-4955-ade4-2614c0a49c4d', '2221f8c8-3172-4586-9ff9-79186e53db3d'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:11:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:14 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:11:14 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:14 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.333s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:14 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:11:14 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Deleted volume successfully. Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a3241172-8e95-4513-aa33-04882687d769 tempest-VolumesTransfersV357Test-198854956 None] Lock "cinder-5c9bfda4-2d5c-4892-9b20-17ad213ee880-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Flow 'volume_create_manager' (7fcb5e78-0c7c-4b09-986e-719c944c0d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e525101-338a-4195-8bee-2bfb7e806059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e525101-338a-4195-8bee-2bfb7e806059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1344447014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d685619e-28b7-478d-afad-2513b163729e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0974addda14627907b2e59b08ee38a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:15Z,use_quota=True,user_id='8cb86c1bbe1e49339b5d9225c86469db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14327b74-8b9a-4db7-a36f-f55a47c48007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14327b74-8b9a-4db7-a36f-f55a47c48007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823acdd2-67b2-43f8-bf14-e5f0da3629c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823acdd2-67b2-43f8-bf14-e5f0da3629c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd685619e-28b7-478d-afad-2513b163729e', 'volume_name': 'volume-d685619e-28b7-478d-afad-2513b163729e', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d5c258-5b24-4b52-900d-61fbfc537e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d5c258-5b24-4b52-900d-61fbfc537e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38efc20-8bec-4052-87c1-881c9aedea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:15 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Volume d685619e-28b7-478d-afad-2513b163729e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d685619e-28b7-478d-afad-2513b163729e', 'volume_size': 1} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1344447014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d685619e-28b7-478d-afad-2513b163729e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0974addda14627907b2e59b08ee38a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:15Z,use_quota=True,user_id='8cb86c1bbe1e49339b5d9225c86469db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Creating volume d685619e-28b7-478d-afad-2513b163729e {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:11:15 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:15 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e 1073741824 Sep 03 20:11:15 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:15 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e 1073741824" returned: 0 in 0.611s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:15 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e Sep 03 20:11:15 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:16 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e" returned: 0 in 0.332s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:11:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38efc20-8bec-4052-87c1-881c9aedea73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d685619e-28b7-478d-afad-2513b163729e', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bff2741-7786-48ba-b3ed-f6b84acc0cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:16 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Volume volume-d685619e-28b7-478d-afad-2513b163729e (d685619e-28b7-478d-afad-2513b163729e): created successfully Sep 03 20:11:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bff2741-7786-48ba-b3ed-f6b84acc0cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Flow 'volume_create_manager' (7fcb5e78-0c7c-4b09-986e-719c944c0d1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:16 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-3f26f652-4168-4026-bd72-53ce790b8989 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Created volume successfully. Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Creating offline snapshot 53424306-f570-43ef-ace1-938bad6832f2 of volume d685619e-28b7-478d-afad-2513b163729e {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0ec31c-5e1d-443d-b9d8-18f12028de9b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:17 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e Sep 03 20:11:17 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Flow 'volume_create_manager' (341245d4-e363-48e5-8257-aa583cf83f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:17 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef7d5b1-0336-43e7-a9e7-fd7d9948f489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e" returned: 0 in 0.459s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef7d5b1-0336-43e7-a9e7-fd7d9948f489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-421134057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944a3409-a01c-4f06-ae7b-67e61a00814a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='062a7a7a64d549cfbf548488fda5b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:18Z,use_quota=True,user_id='67c677c4961d49db95f48d3fe70e0ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:17 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 1G Sep 03 20:11:17 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ca4675-2294-495c-830d-d61cbe02e21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ca4675-2294-495c-830d-d61cbe02e21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6501817-0338-4ccb-897b-57ae665d9f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6501817-0338-4ccb-897b-57ae665d9f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944a3409-a01c-4f06-ae7b-67e61a00814a', 'volume_name': 'volume-944a3409-a01c-4f06-ae7b-67e61a00814a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9c5576-cf35-4063-9320-3169f35736ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9c5576-cf35-4063-9320-3169f35736ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261c4da3-fa96-45b8-b29b-bce70d9eabb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:18 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Volume 944a3409-a01c-4f06-ae7b-67e61a00814a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944a3409-a01c-4f06-ae7b-67e61a00814a', 'volume_size': 1} Sep 03 20:11:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:18 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 1G" returned: 0 in 0.434s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d685619e-28b7-478d-afad-2513b163729e -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:18 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d685619e-28b7-478d-afad-2513b163729e -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 Sep 03 20:11:18 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:18 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d685619e-28b7-478d-afad-2513b163729e -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2" returned: 0 in 0.334s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:18 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 is being set with open permissions: ugo+rw Sep 03 20:11:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:18 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 Sep 03 20:11:18 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:18 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2" returned: 0 in 0.247s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:19 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.info Sep 03 20:11:19 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:19 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.info" returned: 0 in 0.263s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:19 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.info is being set with open permissions: ugo+rw Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:19 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.info Sep 03 20:11:19 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:19 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.info" returned: 0 in 0.255s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.509s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-421134057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944a3409-a01c-4f06-ae7b-67e61a00814a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='062a7a7a64d549cfbf548488fda5b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:18Z,use_quota=True,user_id='67c677c4961d49db95f48d3fe70e0ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Creating volume 944a3409-a01c-4f06-ae7b-67e61a00814a {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:11:19 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:11:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-944a3409-a01c-4f06-ae7b-67e61a00814a 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:19 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-944a3409-a01c-4f06-ae7b-67e61a00814a 1073741824 Sep 03 20:11:19 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:19 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b75b0a72-d32a-4b3a-aeb0-8537e26b875f tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Create snapshot completed successfully Sep 03 20:11:20 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-944a3409-a01c-4f06-ae7b-67e61a00814a 1073741824" returned: 0 in 0.469s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-944a3409-a01c-4f06-ae7b-67e61a00814a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:20 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-944a3409-a01c-4f06-ae7b-67e61a00814a Sep 03 20:11:20 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:20 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-944a3409-a01c-4f06-ae7b-67e61a00814a" returned: 0 in 0.254s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:11:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261c4da3-fa96-45b8-b29b-bce70d9eabb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944a3409-a01c-4f06-ae7b-67e61a00814a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641c13da-9328-4b06-a8ca-657170ce1384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:20 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Volume volume-944a3409-a01c-4f06-ae7b-67e61a00814a (944a3409-a01c-4f06-ae7b-67e61a00814a): created successfully Sep 03 20:11:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641c13da-9328-4b06-a8ca-657170ce1384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Flow 'volume_create_manager' (341245d4-e363-48e5-8257-aa583cf83f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:20 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-500747d0-3b4f-4989-aaf3-f4dacacbb150 tempest-VolumesListTestJSON-1887283207 None] Created volume successfully. Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Acquiring lock "cinder-53424306-f570-43ef-ace1-938bad6832f2-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "cinder-53424306-f570-43ef-ace1-938bad6832f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Acquiring lock "cinder-quobyte-d685619e-28b7-478d-afad-2513b163729e" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "cinder-quobyte-d685619e-28b7-478d-afad-2513b163729e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Acquiring lock "cinder-quobyte-53424306-f570-43ef-ace1-938bad6832f2" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "cinder-quobyte-53424306-f570-43ef-ace1-938bad6832f2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Deleting offline snapshot 53424306-f570-43ef-ace1-938bad6832f2 of volume d685619e-28b7-478d-afad-2513b163729e {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] snapshot_file for this snap is: volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c7d328-05d0-42a5-b691-f0b50685b8e6]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:21 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 Sep 03 20:11:21 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:21 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2" returned: 0 in 0.502s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d685619e-28b7-478d-afad-2513b163729e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[344b5261-30d6-4893-a5ea-55be75eb2ceb]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:11:21 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e Sep 03 20:11:21 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Flow 'volume_create_manager' (408562ee-820f-482d-a796-accacd381d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f93d1ef-e34f-4f6e-a668-feffd907e72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f93d1ef-e34f-4f6e-a668-feffd907e72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1513620329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3327c8c1-824e-4c8c-a66b-f2c5feb25c98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='062a7a7a64d549cfbf548488fda5b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:22Z,use_quota=True,user_id='67c677c4961d49db95f48d3fe70e0ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592be7bd-9c18-4e1a-8bc3-a7f536775a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592be7bd-9c18-4e1a-8bc3-a7f536775a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a678585-fc01-459c-a825-806dba4a8452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a678585-fc01-459c-a825-806dba4a8452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3327c8c1-824e-4c8c-a66b-f2c5feb25c98', 'volume_name': 'volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0ddb0e-ff34-46a8-8bbd-32e1a9a31d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0ddb0e-ff34-46a8-8bbd-32e1a9a31d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5544e0d1-f195-443f-923e-26bd7b761665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:21 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Volume 3327c8c1-824e-4c8c-a66b-f2c5feb25c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98', 'volume_size': 1} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1513620329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3327c8c1-824e-4c8c-a66b-f2c5feb25c98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='062a7a7a64d549cfbf548488fda5b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:22Z,use_quota=True,user_id='67c677c4961d49db95f48d3fe70e0ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Creating volume 3327c8c1-824e-4c8c-a66b-f2c5feb25c98 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:11:21 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:11:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:21 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98 1073741824 Sep 03 20:11:21 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:22 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e" returned: 0 in 0.427s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:22 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 Sep 03 20:11:22 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:22 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98 1073741824" returned: 0 in 0.509s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:22 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:22 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98 Sep 03 20:11:22 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2" returned: 0 in 0.379s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:22 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2 Sep 03 20:11:22 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:22 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98" returned: 0 in 0.297s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:22 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5544e0d1-f195-443f-923e-26bd7b761665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f57e2c-aec8-40ed-8b5d-35abf75de5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e.53424306-f570-43ef-ace1-938bad6832f2" returned: 0 in 0.306s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:22 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Volume volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98 (3327c8c1-824e-4c8c-a66b-f2c5feb25c98): created successfully Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f57e2c-aec8-40ed-8b5d-35abf75de5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Flow 'volume_create_manager' (408562ee-820f-482d-a796-accacd381d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "cinder-quobyte-53424306-f570-43ef-ace1-938bad6832f2" released by "_delete_snapshot" :: held 1.773s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "cinder-quobyte-d685619e-28b7-478d-afad-2513b163729e" released by "delete_snapshot" :: held 1.800s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:22 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ff40f942-d6e6-4388-ac23-5c6b53383504 tempest-VolumesListTestJSON-1887283207 None] Created volume successfully. Sep 03 20:11:22 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Created reservations ['fad77953-979b-4960-949f-35b5b437e047', 'd93f0358-1e4c-4977-ae3a-c83699ab49c2', 'c06f0208-a756-4d48-9af8-896662c22c02', 'f79e3781-d1a1-47cd-bc95-0a7661a8b412'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:11:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Delete snapshot completed successfully. Sep 03 20:11:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-46d5240c-b12f-4186-adb1-b2c6a8624571 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "cinder-53424306-f570-43ef-ace1-938bad6832f2-delete_snapshot" released by "delete_snapshot" :: held 1.971s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Acquiring lock "cinder-d685619e-28b7-478d-afad-2513b163729e-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "cinder-d685619e-28b7-478d-afad-2513b163729e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Acquiring lock "cinder-quobyte-d685619e-28b7-478d-afad-2513b163729e" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "cinder-quobyte-d685619e-28b7-478d-afad-2513b163729e" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:23 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a06bd00-5072-4048-9f4a-98bc89ab400e]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:23 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e Sep 03 20:11:23 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:23 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e" returned: 0 in 0.521s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:24 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e Sep 03 20:11:24 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:24 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d685619e-28b7-478d-afad-2513b163729e" returned: 0 in 0.365s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "cinder-quobyte-d685619e-28b7-478d-afad-2513b163729e" released by "delete_volume" :: held 0.979s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Created reservations ['f326e551-75eb-471f-8c67-9ba6ad565130', '8263d53e-9bc4-41b8-8dd9-3fbd774065bb', 'e4c2b98b-7a8c-446a-9c54-24170a678cf4', '07d6bf6a-005f-4c39-bfc9-f87f2c737a0e'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:24 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:11:24 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Flow 'volume_create_manager' (feca5f44-e5c0-4326-8ce5-e8cf6d0f14c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02deb963-d6f6-4c6b-9b78-3047eaf7c847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02deb963-d6f6-4c6b-9b78-3047eaf7c847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1963507117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c96849-04b9-4978-8c8b-2f9d2c955851,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='062a7a7a64d549cfbf548488fda5b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:25Z,use_quota=True,user_id='67c677c4961d49db95f48d3fe70e0ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfc6fe0-d86f-42f6-b373-c88e3eb72f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfc6fe0-d86f-42f6-b373-c88e3eb72f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9988c725-8e8a-41e3-86e5-419ec1db5bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9988c725-8e8a-41e3-86e5-419ec1db5bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51c96849-04b9-4978-8c8b-2f9d2c955851', 'volume_name': 'volume-51c96849-04b9-4978-8c8b-2f9d2c955851', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d953eb-7774-48c8-b7a7-c5c56773c6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d953eb-7774-48c8-b7a7-c5c56773c6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9ec24d-d7c2-4f40-8f7f-fd9890aefa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:24 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Volume 51c96849-04b9-4978-8c8b-2f9d2c955851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51c96849-04b9-4978-8c8b-2f9d2c955851', 'volume_size': 1} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1963507117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c96849-04b9-4978-8c8b-2f9d2c955851,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='062a7a7a64d549cfbf548488fda5b90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:25Z,use_quota=True,user_id='67c677c4961d49db95f48d3fe70e0ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Creating volume 51c96849-04b9-4978-8c8b-2f9d2c955851 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:11:24 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:11:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-51c96849-04b9-4978-8c8b-2f9d2c955851 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:24 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-51c96849-04b9-4978-8c8b-2f9d2c955851 1073741824 Sep 03 20:11:25 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:25 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.378s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:25 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:11:25 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Deleted volume successfully. Sep 03 20:11:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ee093ed5-bfb7-4af9-943e-0b4d947fa820 tempest-VolumeSnapshotQuotasNegativeTestJSON-885093705 None] Lock "cinder-d685619e-28b7-478d-afad-2513b163729e-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:25 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-51c96849-04b9-4978-8c8b-2f9d2c955851 1073741824" returned: 0 in 0.616s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-51c96849-04b9-4978-8c8b-2f9d2c955851 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:25 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-51c96849-04b9-4978-8c8b-2f9d2c955851 Sep 03 20:11:25 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:26 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-51c96849-04b9-4978-8c8b-2f9d2c955851" returned: 0 in 0.425s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:11:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9ec24d-d7c2-4f40-8f7f-fd9890aefa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51c96849-04b9-4978-8c8b-2f9d2c955851', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54883b92-993b-4687-b1cf-6173016deea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:26 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Volume volume-51c96849-04b9-4978-8c8b-2f9d2c955851 (51c96849-04b9-4978-8c8b-2f9d2c955851): created successfully Sep 03 20:11:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54883b92-993b-4687-b1cf-6173016deea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Flow 'volume_create_manager' (feca5f44-e5c0-4326-8ce5-e8cf6d0f14c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:26 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2a33cb65-ad18-4912-a1f3-c929d07fc119 tempest-VolumesListTestJSON-1887283207 None] Created volume successfully. Sep 03 20:11:26 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-499b4831-39a1-4f1f-bb04-5d8578149189 req-901567d0-03bb-499e-9cfe-096777a95e75 tempest-TestMinimumBasicScenario-1053412317 None] Terminate volume connection completed successfully. Sep 03 20:11:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-499b4831-39a1-4f1f-bb04-5d8578149189 req-901567d0-03bb-499e-9cfe-096777a95e75 tempest-TestMinimumBasicScenario-1053412317 None] Deleting attachment 8726c6f3-3133-40f4-afcc-6ef1ed384253. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:11:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Acquiring lock "cinder-317f5631-175d-4aea-8795-0128deb1a02d-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Lock "cinder-317f5631-175d-4aea-8795-0128deb1a02d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Acquiring lock "cinder-quobyte-317f5631-175d-4aea-8795-0128deb1a02d" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Lock "cinder-quobyte-317f5631-175d-4aea-8795-0128deb1a02d" acquired by "delete_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:27 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[425f96c4-0f79-431a-b91f-03cc08db7ba1]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-317f5631-175d-4aea-8795-0128deb1a02d {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:27 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-317f5631-175d-4aea-8795-0128deb1a02d Sep 03 20:11:27 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:28 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-317f5631-175d-4aea-8795-0128deb1a02d" returned: 0 in 0.522s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-317f5631-175d-4aea-8795-0128deb1a02d {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:28 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-317f5631-175d-4aea-8795-0128deb1a02d Sep 03 20:11:28 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:28 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-317f5631-175d-4aea-8795-0128deb1a02d" returned: 0 in 0.370s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Lock "cinder-quobyte-317f5631-175d-4aea-8795-0128deb1a02d" released by "delete_volume" :: held 0.965s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:28 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Created reservations ['4e77ae63-f8ce-42bb-8061-e54ecf2f8e75', '00bf70b2-a4b3-412c-9c05-01047e4343dc', 'b54a4d8e-315d-4682-8c0a-070547ed251d', '90e243cd-acac-4148-953c-1217e518b592'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:11:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:29 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:11:29 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:29 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.441s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:29 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:11:29 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Deleted volume successfully. Sep 03 20:11:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-58cec782-92ee-4fbe-b4af-0b8eaf1cc9fe tempest-TestMinimumBasicScenario-1053412317 None] Lock "cinder-317f5631-175d-4aea-8795-0128deb1a02d-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "cinder-51c96849-04b9-4978-8c8b-2f9d2c955851-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Lock "cinder-51c96849-04b9-4978-8c8b-2f9d2c955851-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "cinder-quobyte-51c96849-04b9-4978-8c8b-2f9d2c955851" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Lock "cinder-quobyte-51c96849-04b9-4978-8c8b-2f9d2c955851" acquired by "delete_volume" :: waited 0.037s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:30 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[486b25dd-8ec0-4910-b2e2-2092e3d4ad0d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-51c96849-04b9-4978-8c8b-2f9d2c955851 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:30 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-51c96849-04b9-4978-8c8b-2f9d2c955851 Sep 03 20:11:30 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:31 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-51c96849-04b9-4978-8c8b-2f9d2c955851" returned: 0 in 0.639s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-51c96849-04b9-4978-8c8b-2f9d2c955851 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:31 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-51c96849-04b9-4978-8c8b-2f9d2c955851 Sep 03 20:11:31 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:31 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-51c96849-04b9-4978-8c8b-2f9d2c955851" returned: 0 in 0.434s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Lock "cinder-quobyte-51c96849-04b9-4978-8c8b-2f9d2c955851" released by "delete_volume" :: held 1.168s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:31 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Created reservations ['be650e93-b450-4bde-a738-792ca235a10b', 'a7d64311-087c-4096-a64f-c16dbe54df93', '8414137b-790a-4d32-a222-c3225c384dda', '4029a656-b828-48ee-87cb-c89d55ee1a2d'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:11:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:31 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:11:31 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:32 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.462s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:32 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:11:32 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Deleted volume successfully. Sep 03 20:11:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c8ccf7f9-3caf-4227-91bc-c349d9679b72 tempest-VolumesListTestJSON-1887283207 None] Lock "cinder-51c96849-04b9-4978-8c8b-2f9d2c955851-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "cinder-3327c8c1-824e-4c8c-a66b-f2c5feb25c98-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Lock "cinder-3327c8c1-824e-4c8c-a66b-f2c5feb25c98-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "cinder-quobyte-3327c8c1-824e-4c8c-a66b-f2c5feb25c98" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Lock "cinder-quobyte-3327c8c1-824e-4c8c-a66b-f2c5feb25c98" acquired by "delete_volume" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:33 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d8193f-bda9-4e14-b3d4-766e7bed1e41]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:33 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98 Sep 03 20:11:33 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:33 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98" returned: 0 in 0.502s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:33 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98 Sep 03 20:11:33 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:33 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3327c8c1-824e-4c8c-a66b-f2c5feb25c98" returned: 0 in 0.392s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Lock "cinder-quobyte-3327c8c1-824e-4c8c-a66b-f2c5feb25c98" released by "delete_volume" :: held 0.972s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:34 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Created reservations ['60cd54d0-d842-49e3-a287-69a6f74633e5', '97805f9b-bdf9-459a-ab90-f1b2199b94a4', '4243de9b-1658-4511-afac-da6f8bf87fe6', '0ef258c0-4bae-4de9-aec4-43da742ddb46'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:11:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:34 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:11:34 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:34 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.396s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:34 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:11:34 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Deleted volume successfully. Sep 03 20:11:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-58e69051-5cf5-4e5f-aace-04a826abaf9e tempest-VolumesListTestJSON-1887283207 None] Lock "cinder-3327c8c1-824e-4c8c-a66b-f2c5feb25c98-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "cinder-944a3409-a01c-4f06-ae7b-67e61a00814a-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Lock "cinder-944a3409-a01c-4f06-ae7b-67e61a00814a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "cinder-quobyte-944a3409-a01c-4f06-ae7b-67e61a00814a" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Lock "cinder-quobyte-944a3409-a01c-4f06-ae7b-67e61a00814a" acquired by "delete_volume" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:35 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1159ec01-0485-409e-a171-66d8a945c17c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-944a3409-a01c-4f06-ae7b-67e61a00814a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:35 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-944a3409-a01c-4f06-ae7b-67e61a00814a Sep 03 20:11:35 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:36 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-944a3409-a01c-4f06-ae7b-67e61a00814a" returned: 0 in 0.518s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-944a3409-a01c-4f06-ae7b-67e61a00814a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:36 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-944a3409-a01c-4f06-ae7b-67e61a00814a Sep 03 20:11:36 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:36 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-944a3409-a01c-4f06-ae7b-67e61a00814a" returned: 0 in 0.376s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Lock "cinder-quobyte-944a3409-a01c-4f06-ae7b-67e61a00814a" released by "delete_volume" :: held 0.970s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Created reservations ['9a8a5270-6067-4e63-aee5-01386a9caf21', '202f7659-0ac1-492f-bbb9-fbf9f46b5ed8', 'f0f29014-321c-4929-895a-f0acc3dd67a8', '04c99253-7c7f-4bf5-b83f-0fc72cf2b913'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:36 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:11:36 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:36 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:11:36 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Flow 'volume_create_manager' (153a98d9-598c-4dfc-8453-bddf4f4f1116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8c27d3-c66e-4869-adc0-b44da444b4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:37 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8c27d3-c66e-4869-adc0-b44da444b4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-255734416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e597009a-4615-4255-80c5-3f6ea51c45cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f474a1c8a7149ffac80d2f8bce051f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:37Z,use_quota=True,user_id='53da536201184dfda326d13edb4678ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f10e058-529f-4aea-bd3e-45f8e3af923d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f10e058-529f-4aea-bd3e-45f8e3af923d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543bfeca-8bbf-4984-8255-da3d471fdb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.image.glance [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Creating Keystone auth plugin from conf {{(pid=87582) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.346s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 28 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:11:37 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.368s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:11:37 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Deleted volume successfully. Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-12f2bfc8-6fd9-4bb8-95a2-90de863f2f16 tempest-VolumesListTestJSON-1887283207 None] Lock "cinder-944a3409-a01c-4f06-ae7b-67e61a00814a-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543bfeca-8bbf-4984-8255-da3d471fdb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e597009a-4615-4255-80c5-3f6ea51c45cf', 'volume_name': 'volume-e597009a-4615-4255-80c5-3f6ea51c45cf', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834b1c89-9f9f-46c7-8392-5636578e54db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834b1c89-9f9f-46c7-8392-5636578e54db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3994b761-3f0b-4f8e-88c1-03bb5b20b87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:37 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Volume e597009a-4615-4255-80c5-3f6ea51c45cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e597009a-4615-4255-80c5-3f6ea51c45cf', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Trying to clone e597009a-4615-4255-80c5-3f6ea51c45cf from image 2f677e69-c223-4c71-b630-2245f346f65e at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]). {{(pid=87582) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 20:11:37 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Image download 20.69 MB at 20.69 MB/s Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b220adc2-bc6d-447d-bd6d-d6486d5d193d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Flow 'volume_create_manager' (2ef5d492-913f-4eed-8940-2c16b36de337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25917b93-3a47-49d5-92bb-5f6d859d8700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25917b93-3a47-49d5-92bb-5f6d859d8700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-231465161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cedd85-bcb7-4238-9967-88bab96e4170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33493592ece4774ab4fc3e55c50cc70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:38Z,use_quota=True,user_id='ad7f566e339a45f1a8b86ace5f81e87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80918008-ce6f-4d97-a50f-2d58f01cf3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80918008-ce6f-4d97-a50f-2d58f01cf3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:38 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD Sep 03 20:11:38 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9029b9-62d4-4f01-8a80-21158a258dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9029b9-62d4-4f01-8a80-21158a258dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0cedd85-bcb7-4238-9967-88bab96e4170', 'volume_name': 'volume-f0cedd85-bcb7-4238-9967-88bab96e4170', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe59b43-7ee3-4b3d-aa6f-db6dd8782d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe59b43-7ee3-4b3d-aa6f-db6dd8782d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54501240-c6dd-4518-9cc3-a91a0cc4b7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:38 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Volume f0cedd85-bcb7-4238-9967-88bab96e4170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0cedd85-bcb7-4238-9967-88bab96e4170', 'volume_size': 1} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-231465161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cedd85-bcb7-4238-9967-88bab96e4170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33493592ece4774ab4fc3e55c50cc70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:38Z,use_quota=True,user_id='ad7f566e339a45f1a8b86ace5f81e87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Creating volume f0cedd85-bcb7-4238-9967-88bab96e4170 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:11:38 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:38 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 1073741824 Sep 03 20:11:38 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:38 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Temporary image 2f677e69-c223-4c71-b630-2245f346f65e is fetched for user 53da536201184dfda326d13edb4678ba. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fbc4e4-4ded-4874-b135-9a02a1415707]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:38 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD Sep 03 20:11:38 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:38 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 1073741824" returned: 0 in 0.511s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:38 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 Sep 03 20:11:38 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:38 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:39 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170" returned: 0 in 0.371s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.166s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-255734416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e597009a-4615-4255-80c5-3f6ea51c45cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f474a1c8a7149ffac80d2f8bce051f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:37Z,use_quota=True,user_id='53da536201184dfda326d13edb4678ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Creating volume e597009a-4615-4255-80c5-3f6ea51c45cf {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:11:39 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54501240-c6dd-4518-9cc3-a91a0cc4b7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0cedd85-bcb7-4238-9967-88bab96e4170', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23061239-6469-4dc0-84ff-d2d34e86d0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:39 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf 1073741824 Sep 03 20:11:39 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:39 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Volume volume-f0cedd85-bcb7-4238-9967-88bab96e4170 (f0cedd85-bcb7-4238-9967-88bab96e4170): created successfully Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23061239-6469-4dc0-84ff-d2d34e86d0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Flow 'volume_create_manager' (2ef5d492-913f-4eed-8940-2c16b36de337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:39 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2300099c-e1da-4612-9a72-d8a16c05baa5 tempest-VolumesActionsTest-209483103 None] Created volume successfully. Sep 03 20:11:39 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf 1073741824" returned: 0 in 0.611s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:39 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf Sep 03 20:11:39 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:40 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf" returned: 0 in 0.334s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:11:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:40 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Attempting download of 2f677e69-c223-4c71-b630-2245f346f65e ((None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}])) to volume e597009a-4615-4255-80c5-3f6ea51c45cf. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 20:11:40 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb6fdac-0f8a-454e-8019-bdea59777967]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_s6apzagt {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:40 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_s6apzagt Sep 03 20:11:40 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:40 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_s6apzagt" returned: 0 in 0.405s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_s6apzagt {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:40 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_s6apzagt Sep 03 20:11:40 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:41 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_s6apzagt" returned: 1 in 0.391s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_s6apzagt' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c4c955-12d3-417d-9cfb-68b3c3bea814]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:41 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD Sep 03 20:11:41 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:41 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] 2f677e69-c223-4c71-b630-2245f346f65e was qcow2, converting to qcow2 {{(pid=87582) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:41 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf Sep 03 20:11:41 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Flow 'volume_create_manager' (1a224b38-66a6-4d13-b168-507062e53c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa9c3ef-62b7-42ad-b16e-1b075eaa3bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa9c3ef-62b7-42ad-b16e-1b075eaa3bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2112968768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be50eba-d873-4cdb-b9a7-0f044b3350c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8b19be311643d6b13477db48bb403b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:42Z,use_quota=True,user_id='12766f2a89864104b8e5a84dc5bb07ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeaac7cf-6bab-4865-9256-9a6ae4f576c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeaac7cf-6bab-4865-9256-9a6ae4f576c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1075eab4-28c8-4d7c-b7e4-a76d501b4bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1075eab4-28c8-4d7c-b7e4-a76d501b4bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be50eba-d873-4cdb-b9a7-0f044b3350c2', 'volume_name': 'volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bbd099-3bc4-47b8-b597-503181dd8490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bbd099-3bc4-47b8-b597-503181dd8490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349f1479-292b-400c-b59a-976b8924b32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:42 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Volume 8be50eba-d873-4cdb-b9a7-0f044b3350c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2', 'volume_size': 1} Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2112968768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be50eba-d873-4cdb-b9a7-0f044b3350c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8b19be311643d6b13477db48bb403b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:42Z,use_quota=True,user_id='12766f2a89864104b8e5a84dc5bb07ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Creating volume 8be50eba-d873-4cdb-b9a7-0f044b3350c2 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:11:42 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:42 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 1073741824 Sep 03 20:11:42 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:42 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 1073741824" returned: 0 in 0.759s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:42 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 Sep 03 20:11:42 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:43 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2" returned: 0 in 0.377s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:11:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349f1479-292b-400c-b59a-976b8924b32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93717949-3010-4af1-aa0f-0740fa81479d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:43 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Volume volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 (8be50eba-d873-4cdb-b9a7-0f044b3350c2): created successfully Sep 03 20:11:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93717949-3010-4af1-aa0f-0740fa81479d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Flow 'volume_create_manager' (1a224b38-66a6-4d13-b168-507062e53c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:43 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-4913c585-0d0a-4e49-812b-ef77f5d407ed tempest-VolumesSnapshotListTestJSON-2141343330 None] Created volume successfully. Sep 03 20:11:44 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf" returned: 0 in 2.582s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_cmkxn5jhdevstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:11:44 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Converted 112.00 MB image at 43.23 MB/s Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:44 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf 1G Sep 03 20:11:44 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] Creating offline snapshot 564cf4c8-2c20-49fd-b799-84ad844853f3 of volume 8be50eba-d873-4cdb-b9a7-0f044b3350c2 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0996d337-b954-4168-80e7-f5f7f9b9efa6]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:44 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 Sep 03 20:11:44 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:44 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf 1G" returned: 0 in 0.531s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Downloaded image 2f677e69-c223-4c71-b630-2245f346f65e ((None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}])) to volume e597009a-4615-4255-80c5-3f6ea51c45cf successfully. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Temporary image 2f677e69-c223-4c71-b630-2245f346f65e for user 53da536201184dfda326d13edb4678ba is deleted. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Marking volume e597009a-4615-4255-80c5-3f6ea51c45cf as bootable. {{(pid=87582) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Copying metadata from image 2f677e69-c223-4c71-b630-2245f346f65e to e597009a-4615-4255-80c5-3f6ea51c45cf. {{(pid=87582) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Creating volume glance metadata for volume e597009a-4615-4255-80c5-3f6ea51c45cf backed by image 2f677e69-c223-4c71-b630-2245f346f65e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87582) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3994b761-3f0b-4f8e-88c1-03bb5b20b87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e597009a-4615-4255-80c5-3f6ea51c45cf', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3d142e-9752-4e11-a320-f59d2137cd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:44 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Volume volume-e597009a-4615-4255-80c5-3f6ea51c45cf (e597009a-4615-4255-80c5-3f6ea51c45cf): created successfully Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3d142e-9752-4e11-a320-f59d2137cd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Flow 'volume_create_manager' (153a98d9-598c-4dfc-8453-bddf4f4f1116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:44 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7f7f48a8-f95f-49dd-9b77-2592ca6a8079 tempest-VolumesImageMetadata-1550497564 None] Created volume successfully. Sep 03 20:11:44 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2" returned: 0 in 0.488s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:45 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 1G Sep 03 20:11:45 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:45 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 1G" returned: 0 in 0.598s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:45 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 Sep 03 20:11:45 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:45 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3" returned: 0 in 0.433s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:46 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 is being set with open permissions: ugo+rw Sep 03 20:11:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:46 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 Sep 03 20:11:46 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:46 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3" returned: 0 in 0.318s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Acquiring lock "cinder-e597009a-4615-4255-80c5-3f6ea51c45cf-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Lock "cinder-e597009a-4615-4255-80c5-3f6ea51c45cf-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:46 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.info Sep 03 20:11:46 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Acquiring lock "cinder-quobyte-e597009a-4615-4255-80c5-3f6ea51c45cf" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Lock "cinder-quobyte-e597009a-4615-4255-80c5-3f6ea51c45cf" acquired by "delete_volume" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:46 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5d7b64-896a-450f-817c-9a5a6de384b0]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:46 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf Sep 03 20:11:46 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:46 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.info" returned: 0 in 0.431s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:46 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.info is being set with open permissions: ugo+rw Sep 03 20:11:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:46 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.info Sep 03 20:11:46 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:47 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf" returned: 0 in 0.520s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:47 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf Sep 03 20:11:47 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:47 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.info" returned: 0 in 0.354s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.780s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-74a0f5b7-2653-403b-bab7-9dc34a62be4d tempest-VolumesSnapshotListTestJSON-2141343330 None] Create snapshot completed successfully Sep 03 20:11:47 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e597009a-4615-4255-80c5-3f6ea51c45cf" returned: 0 in 0.525s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Lock "cinder-quobyte-e597009a-4615-4255-80c5-3f6ea51c45cf" released by "delete_volume" :: held 1.131s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:47 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Created reservations ['7e623614-a75b-4a0d-858d-27cae6e9a661', '620dbadf-6107-495e-bf2b-9cc137342250', '03cffe9c-057e-4568-ab21-d24777258a2a', '0ee4af84-139e-4eaa-bd68-051f6d978aea'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:11:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:48 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:11:48 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] Creating offline snapshot 5119fd6a-955c-4513-9653-378535e96a4a of volume 8be50eba-d873-4cdb-b9a7-0f044b3350c2 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:11:48 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81bc1df-ad9e-4f7d-8054-183e33622aa5]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:48 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.635s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:48 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:11:48 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 Sep 03 20:11:48 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Deleted volume successfully. Sep 03 20:11:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-84b88733-7f6d-40bc-affe-5e79876382c2 tempest-VolumesImageMetadata-1550497564 None] Lock "cinder-e597009a-4615-4255-80c5-3f6ea51c45cf-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:49 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3" returned: 0 in 0.888s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:11:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:49 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a 1G Sep 03 20:11:49 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:50 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a 1G" returned: 0 in 1.098s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:50 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a Sep 03 20:11:50 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1266ef65-7f3e-45a0-8edd-ed364b57c224 tempest-VolumesActionsTest-209483103 None] Acquiring lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170" by "attach_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1266ef65-7f3e-45a0-8edd-ed364b57c224 tempest-VolumesActionsTest-209483103 None] Lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170" acquired by "attach_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:50 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a" returned: 0 in 0.647s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:50 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a is being set with open permissions: ugo+rw Sep 03 20:11:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:51 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a Sep 03 20:11:51 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:51 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-1266ef65-7f3e-45a0-8edd-ed364b57c224 tempest-VolumesActionsTest-209483103 None] Attaching volume f0cedd85-bcb7-4238-9967-88bab96e4170 to instance c306bbfc-4799-440b-b514-eaf57ccdec06 at mountpoint /dev/vdb on host None. Sep 03 20:11:51 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-1266ef65-7f3e-45a0-8edd-ed364b57c224 tempest-VolumesActionsTest-209483103 None] Attach volume completed successfully. Sep 03 20:11:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1266ef65-7f3e-45a0-8edd-ed364b57c224 tempest-VolumesActionsTest-209483103 None] Lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170" released by "attach_volume" :: held 0.203s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-53c6fca6-c765-4829-9ef5-4189f48b1096 tempest-VolumesActionsTest-209483103 None] Acquiring lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170-detach_volume" by "detach_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-53c6fca6-c765-4829-9ef5-4189f48b1096 tempest-VolumesActionsTest-209483103 None] Lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:51 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-53c6fca6-c765-4829-9ef5-4189f48b1096 tempest-VolumesActionsTest-209483103 None] Detaching volume f0cedd85-bcb7-4238-9967-88bab96e4170 from instance c306bbfc-4799-440b-b514-eaf57ccdec06. Sep 03 20:11:51 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a" returned: 0 in 0.461s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.327s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:51 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-53c6fca6-c765-4829-9ef5-4189f48b1096 tempest-VolumesActionsTest-209483103 None] Detach volume completed successfully. Sep 03 20:11:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-53c6fca6-c765-4829-9ef5-4189f48b1096 tempest-VolumesActionsTest-209483103 None] Lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170-detach_volume" released by "detach_volume" :: held 0.171s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:51 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-951e9286-bb64-4965-aadd-8deb83d9c247 tempest-VolumesSnapshotListTestJSON-2141343330 None] Create snapshot completed successfully Sep 03 20:11:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] Creating offline snapshot fb5db6bb-8f75-4b44-adab-1d4a5540b966 of volume 8be50eba-d873-4cdb-b9a7-0f044b3350c2 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:11:52 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af7454f-b9fb-4edc-8d05-4827e2193a1b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:53 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a Sep 03 20:11:53 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:53 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a" returned: 0 in 0.603s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:11:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:53 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 1G Sep 03 20:11:53 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:54 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 1G" returned: 0 in 0.667s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:54 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 Sep 03 20:11:54 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:54 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966" returned: 0 in 0.404s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:54 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 is being set with open permissions: ugo+rw Sep 03 20:11:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:54 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 Sep 03 20:11:54 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:54 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:11:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Flow 'volume_create_manager' (c0875888-fee8-44d4-82a2-63ac49c01948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48a8e40-fed2-4815-9b06-b05bfed64b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48a8e40-fed2-4815-9b06-b05bfed64b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-692068050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35ab85a-6484-4ad8-9668-a57c26c7dd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769817f7c8f74cd7a00a5b3ae5cdcb7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:55Z,use_quota=True,user_id='d4001078798149bfb3812882945b8fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5828a8bf-478d-49f5-9de6-3d4d0cf9ec7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5828a8bf-478d-49f5-9de6-3d4d0cf9ec7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0320e702-94ab-44c5-adf2-ac0b3ed23e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0320e702-94ab-44c5-adf2-ac0b3ed23e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35ab85a-6484-4ad8-9668-a57c26c7dd0f', 'volume_name': 'volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d072ff7-6962-4203-9e4e-22ff0c5ac4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d072ff7-6962-4203-9e4e-22ff0c5ac4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfb9407-c289-4823-a0cb-acf9074d7faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:55 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Volume f35ab85a-6484-4ad8-9668-a57c26c7dd0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f', 'volume_size': 1} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:55 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966" returned: 0 in 0.429s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.097s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-692068050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35ab85a-6484-4ad8-9668-a57c26c7dd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769817f7c8f74cd7a00a5b3ae5cdcb7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:11:55Z,use_quota=True,user_id='d4001078798149bfb3812882945b8fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Creating volume f35ab85a-6484-4ad8-9668-a57c26c7dd0f {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:11:55 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:55 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f 1073741824 Sep 03 20:11:55 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:55 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6fa229b5-43e7-4b97-bc4e-4403fbc8f1c7 tempest-VolumesSnapshotListTestJSON-2141343330 None] Create snapshot completed successfully Sep 03 20:11:55 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f 1073741824" returned: 0 in 0.549s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:55 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f Sep 03 20:11:55 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:56 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f" returned: 0 in 0.295s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:11:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:11:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfb9407-c289-4823-a0cb-acf9074d7faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a12529-7f7a-4227-aad1-27fdcd259462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:11:56 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Volume volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f (f35ab85a-6484-4ad8-9668-a57c26c7dd0f): created successfully Sep 03 20:11:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a12529-7f7a-4227-aad1-27fdcd259462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:11:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Flow 'volume_create_manager' (c0875888-fee8-44d4-82a2-63ac49c01948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:11:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f2dce5e7-4f6e-40dd-9d72-cc545aded56b tempest-SnapshotMetadataTestJSON-799412764 None] Created volume successfully. Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "cinder-fb5db6bb-8f75-4b44-adab-1d4a5540b966-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-fb5db6bb-8f75-4b44-adab-1d4a5540b966-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "cinder-quobyte-8be50eba-d873-4cdb-b9a7-0f044b3350c2" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-8be50eba-d873-4cdb-b9a7-0f044b3350c2" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "cinder-quobyte-fb5db6bb-8f75-4b44-adab-1d4a5540b966" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-fb5db6bb-8f75-4b44-adab-1d4a5540b966" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Deleting offline snapshot fb5db6bb-8f75-4b44-adab-1d4a5540b966 of volume 8be50eba-d873-4cdb-b9a7-0f044b3350c2 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] snapshot_file for this snap is: volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6b737a-a387-41e8-9e90-3bb0d4d50313]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] Creating offline snapshot f5fd7f22-f447-48dd-b94e-876a75ee2031 of volume f35ab85a-6484-4ad8-9668-a57c26c7dd0f {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[55de807b-809b-49c4-810f-d476d9a36a18]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:57 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 Sep 03 20:11:57 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:57 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f Sep 03 20:11:57 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:57 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966" returned: 0 in 0.585s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:11:58 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[825bbc3c-e2fc-460a-a06e-ab74a39b93d2]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:11:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:58 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f" returned: 0 in 0.552s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:58 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 1G Sep 03 20:11:58 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:58 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a Sep 03 20:11:58 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:58 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a" returned: 0 in 0.624s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:11:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:58 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 Sep 03 20:11:58 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:58 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 1G" returned: 0 in 0.736s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:58 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 Sep 03 20:11:58 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:59 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031" returned: 0 in 0.399s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:59 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 is being set with open permissions: ugo+rw Sep 03 20:11:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:59 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 Sep 03 20:11:59 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:59 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966" returned: 0 in 0.622s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:59 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966 Sep 03 20:11:59 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:59 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031" returned: 0 in 0.343s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:59 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Sep 03 20:11:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.fb5db6bb-8f75-4b44-adab-1d4a5540b966" returned: 0 in 0.306s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:11:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:11:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-fb5db6bb-8f75-4b44-adab-1d4a5540b966" released by "_delete_snapshot" :: held 2.322s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-8be50eba-d873-4cdb-b9a7-0f044b3350c2" released by "delete_snapshot" :: held 2.377s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:11:59 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.info Sep 03 20:11:59 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:11:59 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Created reservations ['2c7046f9-fdfa-485c-8488-5f5037073e7f', '7cb64075-85ad-4b0d-a4b2-3da9566bb581', '99fec6b7-2489-451e-aef2-c0a262ceff8b', '2d733400-314d-400a-a561-ef6ab30832eb'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:11:59 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Delete snapshot completed successfully. Sep 03 20:11:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8cbea847-6bcc-4bec-83e5-4c2e6ca67b29 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-fb5db6bb-8f75-4b44-adab-1d4a5540b966-delete_snapshot" released by "delete_snapshot" :: held 2.611s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:00 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.info" returned: 0 in 0.393s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:00 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.info is being set with open permissions: ugo+rw Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:00 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.info Sep 03 20:12:00 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:00 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.info" returned: 0 in 0.311s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.977s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:12:00 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2352c194-12eb-41fa-b732-e17a5019b245 tempest-SnapshotMetadataTestJSON-799412764 None] Create snapshot completed successfully Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "cinder-5119fd6a-955c-4513-9653-378535e96a4a-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-5119fd6a-955c-4513-9653-378535e96a4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "cinder-quobyte-8be50eba-d873-4cdb-b9a7-0f044b3350c2" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-8be50eba-d873-4cdb-b9a7-0f044b3350c2" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "cinder-quobyte-5119fd6a-955c-4513-9653-378535e96a4a" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-5119fd6a-955c-4513-9653-378535e96a4a" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Deleting offline snapshot 5119fd6a-955c-4513-9653-378535e96a4a of volume 8be50eba-d873-4cdb-b9a7-0f044b3350c2 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] snapshot_file for this snap is: volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c6c066-572a-4593-9a61-1e0c417e2774]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:00 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a Sep 03 20:12:00 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:01 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a" returned: 0 in 0.485s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae8f11e-8243-4e00-8806-fd07d5126cbf]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:01 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 Sep 03 20:12:01 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Acquiring lock "cinder-f5fd7f22-f447-48dd-b94e-876a75ee2031-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "cinder-f5fd7f22-f447-48dd-b94e-876a75ee2031-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Acquiring lock "cinder-quobyte-f35ab85a-6484-4ad8-9668-a57c26c7dd0f" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "cinder-quobyte-f35ab85a-6484-4ad8-9668-a57c26c7dd0f" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Acquiring lock "cinder-quobyte-f5fd7f22-f447-48dd-b94e-876a75ee2031" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:01 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3" returned: 0 in 0.550s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "cinder-quobyte-f5fd7f22-f447-48dd-b94e-876a75ee2031" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Deleting offline snapshot f5fd7f22-f447-48dd-b94e-876a75ee2031 of volume f35ab85a-6484-4ad8-9668-a57c26c7dd0f {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:12:01 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a Sep 03 20:12:01 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] snapshot_file for this snap is: volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43e2d0b-baaa-4b91-ac68-247b19fb0186]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:02 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 Sep 03 20:12:02 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:02 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a" returned: 0 in 0.784s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:02 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a Sep 03 20:12:02 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:02 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031" returned: 0 in 0.873s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:12:02 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcba1e2c-603a-4a73-86c8-74bd809821e0]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:03 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f Sep 03 20:12:03 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:03 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.5119fd6a-955c-4513-9653-378535e96a4a" returned: 0 in 0.642s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-5119fd6a-955c-4513-9653-378535e96a4a" released by "_delete_snapshot" :: held 2.650s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-8be50eba-d873-4cdb-b9a7-0f044b3350c2" released by "delete_snapshot" :: held 2.703s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:03 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=138,cinder:UPDATE=168,cinder:INSERT=44,cinder:DELETE=12 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:12:03 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Created reservations ['c4167289-daaf-4ff3-b500-97a2fae5f964', '0257ce07-1370-46b5-a011-0a8255923692', '2d8f847a-7e43-4688-b61e-173f6c149774', '7e0452d9-a767-4026-bae3-d5e67d2d3808'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:12:03 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f" returned: 0 in 0.759s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:03 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 Sep 03 20:12:03 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:03 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Delete snapshot completed successfully. Sep 03 20:12:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90bb921f-3c9c-438b-988e-85c9fd518387 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-5119fd6a-955c-4513-9653-378535e96a4a-delete_snapshot" released by "delete_snapshot" :: held 3.179s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "cinder-564cf4c8-2c20-49fd-b799-84ad844853f3-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-564cf4c8-2c20-49fd-b799-84ad844853f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "cinder-quobyte-8be50eba-d873-4cdb-b9a7-0f044b3350c2" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-8be50eba-d873-4cdb-b9a7-0f044b3350c2" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "cinder-quobyte-564cf4c8-2c20-49fd-b799-84ad844853f3" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-564cf4c8-2c20-49fd-b799-84ad844853f3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Deleting offline snapshot 564cf4c8-2c20-49fd-b799-84ad844853f3 of volume 8be50eba-d873-4cdb-b9a7-0f044b3350c2 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:12:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] snapshot_file for this snap is: volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:12:04 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[709f779a-126e-4f47-87e2-bbb849150487]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:04 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 Sep 03 20:12:04 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:04 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031" returned: 0 in 0.925s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:04 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031 Sep 03 20:12:04 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:04 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3" returned: 0 in 0.746s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:12:05 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5498844-914d-4825-93be-25c886c13831]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:05 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f.f5fd7f22-f447-48dd-b94e-876a75ee2031" returned: 0 in 0.550s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:05 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 Sep 03 20:12:05 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "cinder-quobyte-f5fd7f22-f447-48dd-b94e-876a75ee2031" released by "_delete_snapshot" :: held 3.390s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "cinder-quobyte-f35ab85a-6484-4ad8-9668-a57c26c7dd0f" released by "delete_snapshot" :: held 3.461s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:05 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Created reservations ['71fbfb4a-651f-4910-b4e6-2a545e2db16b', '2e463bb8-2d2b-4098-b869-9d32210541af', '64e88da4-5c00-437e-a17e-68202a82a6a8', 'f2240c3e-9566-45ad-b15f-8a19a9456760'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:12:05 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2" returned: 0 in 0.509s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:05 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 Sep 03 20:12:05 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:05 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Delete snapshot completed successfully. Sep 03 20:12:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-89a066b2-6890-4981-a97f-c861f35091c4 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "cinder-f5fd7f22-f447-48dd-b94e-876a75ee2031-delete_snapshot" released by "delete_snapshot" :: held 3.841s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:06 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3" returned: 0 in 0.541s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:06 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3 Sep 03 20:12:06 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Acquiring lock "cinder-f35ab85a-6484-4ad8-9668-a57c26c7dd0f-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "cinder-f35ab85a-6484-4ad8-9668-a57c26c7dd0f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Acquiring lock "cinder-quobyte-f35ab85a-6484-4ad8-9668-a57c26c7dd0f" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "cinder-quobyte-f35ab85a-6484-4ad8-9668-a57c26c7dd0f" acquired by "delete_volume" :: waited 0.036s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:06 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2.564cf4c8-2c20-49fd-b799-84ad844853f3" returned: 0 in 0.545s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:06 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0909b065-45ad-4937-ad78-0713dda40bb3]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-564cf4c8-2c20-49fd-b799-84ad844853f3" released by "_delete_snapshot" :: held 2.666s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-8be50eba-d873-4cdb-b9a7-0f044b3350c2" released by "delete_snapshot" :: held 2.713s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:06 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f Sep 03 20:12:06 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:06 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Created reservations ['f47ebe87-bdf4-4c26-9a13-a81122973cd8', '16e75291-dd19-41b3-a154-5b9e585d04ab', '6d4b5c97-9e0a-4968-ace6-86f8ccff68bb', '38061556-3c0c-436f-b8d4-53a6b0859546'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:12:07 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Delete snapshot completed successfully. Sep 03 20:12:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87a53094-5ed4-476a-9e2b-c30675111d79 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-564cf4c8-2c20-49fd-b799-84ad844853f3-delete_snapshot" released by "delete_snapshot" :: held 3.111s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:07 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f" returned: 0 in 0.695s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:07 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f Sep 03 20:12:07 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "cinder-8be50eba-d873-4cdb-b9a7-0f044b3350c2-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-8be50eba-d873-4cdb-b9a7-0f044b3350c2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "cinder-quobyte-8be50eba-d873-4cdb-b9a7-0f044b3350c2" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-8be50eba-d873-4cdb-b9a7-0f044b3350c2" acquired by "delete_volume" :: waited 0.038s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:07 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5541f3b7-4492-4893-985a-f208d461fc1d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:07 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f35ab85a-6484-4ad8-9668-a57c26c7dd0f" returned: 0 in 0.653s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "cinder-quobyte-f35ab85a-6484-4ad8-9668-a57c26c7dd0f" released by "delete_volume" :: held 1.493s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-905470d9-349b-42e7-99a6-1f253927a96b tempest-VolumesActionsTest-209483103 None] Acquiring lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170" by "attach_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:08 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 Sep 03 20:12:08 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-905470d9-349b-42e7-99a6-1f253927a96b tempest-VolumesActionsTest-209483103 None] Lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170" acquired by "attach_volume" :: waited 0.048s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:UPDATE=141,cinder:SELECT=131,cinder:INSERT=48,cinder:DELETE=14 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Created reservations ['04b8cd46-7f09-4565-9a3a-e151cacabac9', '6129df0f-0540-440a-bae3-0fb31c55d428', '4eca1d60-1953-475c-9b9b-6ecd537cbb57', '9a7d8346-8a07-4d79-bdf2-73875369ece9'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:12:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-905470d9-349b-42e7-99a6-1f253927a96b tempest-VolumesActionsTest-209483103 None] Attaching volume f0cedd85-bcb7-4238-9967-88bab96e4170 to instance 04e4e3ab-0ed5-4a3d-827b-9b47d5985aa1 at mountpoint /dev/vdb on host None. Sep 03 20:12:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-905470d9-349b-42e7-99a6-1f253927a96b tempest-VolumesActionsTest-209483103 None] Attach volume completed successfully. Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-905470d9-349b-42e7-99a6-1f253927a96b tempest-VolumesActionsTest-209483103 None] Lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170" released by "attach_volume" :: held 0.297s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:08 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:12:08 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:08 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2" returned: 0 in 0.746s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:08 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2 Sep 03 20:12:08 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a39e09d8-492e-4505-a11b-d7924059f425 tempest-VolumesActionsTest-209483103 None] Acquiring lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170-detach_volume" by "detach_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a39e09d8-492e-4505-a11b-d7924059f425 tempest-VolumesActionsTest-209483103 None] Lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:12:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a39e09d8-492e-4505-a11b-d7924059f425 tempest-VolumesActionsTest-209483103 None] Detaching volume f0cedd85-bcb7-4238-9967-88bab96e4170 from instance 04e4e3ab-0ed5-4a3d-827b-9b47d5985aa1. Sep 03 20:12:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a39e09d8-492e-4505-a11b-d7924059f425 tempest-VolumesActionsTest-209483103 None] Detach volume completed successfully. Sep 03 20:12:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a39e09d8-492e-4505-a11b-d7924059f425 tempest-VolumesActionsTest-209483103 None] Lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170-detach_volume" released by "detach_volume" :: held 0.142s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:09 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.666s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:09 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:12:09 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Deleted volume successfully. Sep 03 20:12:09 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8be50eba-d873-4cdb-b9a7-0f044b3350c2" returned: 0 in 0.578s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-quobyte-8be50eba-d873-4cdb-b9a7-0f044b3350c2" released by "delete_volume" :: held 1.463s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-241bff52-99ba-4301-960c-5512fae32a99 tempest-SnapshotMetadataTestJSON-799412764 None] Lock "cinder-f35ab85a-6484-4ad8-9668-a57c26c7dd0f-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:09 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Created reservations ['6cf249ed-6197-4b05-ad2b-9ae4bc31dd5a', 'b8e51951-799e-4738-8154-521eae4a0b9f', '4dc1e3b5-319e-49c2-b1cd-222884e02cbe', 'eb61a584-28d5-4d28-bff0-0984cb5a2cc7'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:12:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:12:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:12:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:12:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:12:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:12:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:09 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:12:09 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:10 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.396s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:10 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:12:10 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Deleted volume successfully. Sep 03 20:12:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ecaeb502-130f-4d3c-abd2-08691a0838e5 tempest-VolumesSnapshotListTestJSON-2141343330 None] Lock "cinder-8be50eba-d873-4cdb-b9a7-0f044b3350c2-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:12:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:12:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:12:15 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c42a2c-4489-4d8c-834b-5546b29524c5]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:15 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 Sep 03 20:12:15 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:16 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170" returned: 0 in 0.436s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:16 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d66e4e1-6792-453f-99da-83311e7a065b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:16 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 Sep 03 20:12:16 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:16 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170" returned: 0 in 0.490s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.a2954553-7986-4b74-a806-550009924f29ryvym3v2.img {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:16 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.a2954553-7986-4b74-a806-550009924f29ryvym3v2.img Sep 03 20:12:16 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:22 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.a2954553-7986-4b74-a806-550009924f29ryvym3v2.img" returned: 0 in 5.463s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:22 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a6a106-82aa-4072-905e-ad342004ac34]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:22 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 Sep 03 20:12:22 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:22 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170" returned: 0 in 0.549s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:22 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.a2954553-7986-4b74-a806-550009924f29ryvym3v2.img {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:12:22 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] Converted 1024.00 MB image at 187.34 MB/s Sep 03 20:12:22 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] a2954553-7986-4b74-a806-550009924f29 was raw, no need to convert to raw {{(pid=87582) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 03 20:12:28 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:UPDATE=16,cinder:SELECT=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:12:32 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:INSERT=11,cinder:UPDATE=36,cinder:SELECT=37,cinder:DELETE=1 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:12:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:12:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:12:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:12:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:12:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:12:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:12:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:36 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:12:36 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:37 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.348s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:12:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:12:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 28 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:12:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:12:41 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:12:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Flow 'volume_create_manager' (db9f3368-79e7-4694-a2a0-c9cba3d10aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:12:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97529ac1-a1ae-4b88-b0b4-b2309e383538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97529ac1-a1ae-4b88-b0b4-b2309e383538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1144998553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ab7e30-4c22-4c1e-8239-55e033e2dba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88243f82b60e4f00b25483b9fb825fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:12:42Z,use_quota=True,user_id='78a7639d6cc6443a949c63271bb02328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e058f6f-c9a4-4bbc-bb45-4447666fc5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e058f6f-c9a4-4bbc-bb45-4447666fc5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70a9048-5f76-437f-8aab-2ea0f992136a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70a9048-5f76-437f-8aab-2ea0f992136a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68ab7e30-4c22-4c1e-8239-55e033e2dba8', 'volume_name': 'volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c6eb5c-e602-48f3-95b7-651a43ea7db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c6eb5c-e602-48f3-95b7-651a43ea7db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec8e28b-c2e1-484e-951a-5f0a5ecece9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:41 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Volume 68ab7e30-4c22-4c1e-8239-55e033e2dba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8', 'volume_size': 1} Sep 03 20:12:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:12:43 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:12:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Flow 'volume_create_manager' (cf41e57f-601c-4d8b-b9a6-a7fff70be3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:12:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75d316b-0990-4fba-82d9-09b78b436dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75d316b-0990-4fba-82d9-09b78b436dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1278095991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04098dac-14f1-4ea9-b679-070b74c3b107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ba63365de54e01b212eab35a883381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:12:43Z,use_quota=True,user_id='b64369132a9548379f50371c6efab192',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a41a2e-ae4b-4428-af75-004e56547d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a41a2e-ae4b-4428-af75-004e56547d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe766979-38dc-4163-af89-b20964c28b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:43 devstack cinder-volume[87582]: DEBUG cinder.image.glance [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Creating Keystone auth plugin from conf {{(pid=87582) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 20:12:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe766979-38dc-4163-af89-b20964c28b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '04098dac-14f1-4ea9-b679-070b74c3b107', 'volume_name': 'volume-04098dac-14f1-4ea9-b679-070b74c3b107', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45845aa-1fb6-498f-9de1-0e5f458a3333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45845aa-1fb6-498f-9de1-0e5f458a3333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b085225b-41b8-48d8-a083-bc8b97fbd330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:43 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Volume 04098dac-14f1-4ea9-b679-070b74c3b107: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-04098dac-14f1-4ea9-b679-070b74c3b107', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 20:12:43 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Trying to clone 04098dac-14f1-4ea9-b679-070b74c3b107 from image 2f677e69-c223-4c71-b630-2245f346f65e at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]). {{(pid=87582) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 20:12:44 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 20:12:44 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Image download 20.69 MB at 20.69 MB/s Sep 03 20:12:44 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4decc7e4-64f5-48f4-bdef-37daa2858149]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:44 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD Sep 03 20:12:44 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:44 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:44 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Temporary image 2f677e69-c223-4c71-b630-2245f346f65e is fetched for user b64369132a9548379f50371c6efab192. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 20:12:44 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcca1a6-2306-41e1-a2ab-8c7229f1d34d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:45 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD Sep 03 20:12:45 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:45 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.504s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] Uploaded volume to glance image-id: a2954553-7986-4b74-a806-550009924f29. {{(pid=87582) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.246s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1144998553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ab7e30-4c22-4c1e-8239-55e033e2dba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88243f82b60e4f00b25483b9fb825fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:12:42Z,use_quota=True,user_id='78a7639d6cc6443a949c63271bb02328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Creating volume 68ab7e30-4c22-4c1e-8239-55e033e2dba8 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:12:49 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:49 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 1073741824 Sep 03 20:12:49 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:49 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a3598ad2-aa3b-4d29-9e8b-4dd81987aa8a tempest-VolumesActionsTest-209483103 None] Copy volume to image completed successfully. Sep 03 20:12:49 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 1073741824" returned: 0 in 0.512s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:49 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 Sep 03 20:12:49 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:50 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8" returned: 0 in 0.373s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.722s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1278095991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04098dac-14f1-4ea9-b679-070b74c3b107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ba63365de54e01b212eab35a883381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:12:43Z,use_quota=True,user_id='b64369132a9548379f50371c6efab192',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Creating volume 04098dac-14f1-4ea9-b679-070b74c3b107 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:12:50 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:50 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 1073741824 Sep 03 20:12:50 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec8e28b-c2e1-484e-951a-5f0a5ecece9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85c624d-796d-49ad-affd-63f5a6f92edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:50 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Volume volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 (68ab7e30-4c22-4c1e-8239-55e033e2dba8): created successfully Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85c624d-796d-49ad-affd-63f5a6f92edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Flow 'volume_create_manager' (db9f3368-79e7-4694-a2a0-c9cba3d10aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:12:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f941e3b4-7a82-466b-b346-5ea1b2d7f72c tempest-VolumesSnapshotTestJSON-882480365 None] Created volume successfully. Sep 03 20:12:50 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 1073741824" returned: 0 in 0.638s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:12:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:50 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 Sep 03 20:12:50 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:51 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107" returned: 0 in 0.291s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:12:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:12:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.315s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:12:51 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe439f0f-6eec-410e-8579-2bd712f5cfb6]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:51 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 Sep 03 20:12:51 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:51 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170" returned: 0 in 0.400s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:51 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9e38fe-0882-4558-b6cc-d5ea0732303b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:51 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Attempting download of 2f677e69-c223-4c71-b630-2245f346f65e ((None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}])) to volume 04098dac-14f1-4ea9-b679-070b74c3b107. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 20:12:51 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2d3915-093f-4df5-8527-b323451bf80e]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_rcg702m9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:51 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 Sep 03 20:12:51 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:12:51 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_rcg702m9 Sep 03 20:12:51 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:52 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170" returned: 0 in 0.518s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:52 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img Sep 03 20:12:52 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:52 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_rcg702m9" returned: 0 in 0.456s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_rcg702m9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:52 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_rcg702m9 Sep 03 20:12:52 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:52 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_rcg702m9" returned: 1 in 0.376s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f677e69-c223-4c71-b630-2245f346f65e_rcg702m9' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:12:52 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfba0af-b866-43f6-9424-c394002e8965]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:52 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD Sep 03 20:12:52 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:53 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:53 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] 2f677e69-c223-4c71-b630-2245f346f65e was qcow2, converting to qcow2 {{(pid=87582) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 20:12:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:53 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 Sep 03 20:12:53 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:57 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img" returned: 0 in 5.230s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e196a3e7-df85-439b-8508-b02bb0be3459]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:57 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 Sep 03 20:12:57 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:57 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107" returned: 0 in 4.185s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f677e69-c223-4c71-b630-2245f346f65e_9b_o_z7bdevstack@QuobyteHD, size 112.00 MB, duration 4.19 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:12:57 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Converted 112.00 MB image at 26.74 MB/s Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:57 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 1G Sep 03 20:12:57 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Flow 'volume_create_manager' (4ce516ce-e970-40ab-b776-c6d86395049d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86613b61-6ca8-4ce0-9d5d-04ce0e169cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86613b61-6ca8-4ce0-9d5d-04ce0e169cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1590965803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8957f262-1c50-49c5-83e2-44d02c2ed7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b489fad0e5914dc29fe47a407e939e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:12:58Z,use_quota=True,user_id='d7da25653423451bb8e55a3857634402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5b9c30-01c2-4227-8992-1a09dc518f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5b9c30-01c2-4227-8992-1a09dc518f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9bfb6a-d27f-456a-849d-ffb930f4f052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9bfb6a-d27f-456a-849d-ffb930f4f052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8957f262-1c50-49c5-83e2-44d02c2ed7a2', 'volume_name': 'volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddae2f1d-3fcf-4325-8357-cdf9473330e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddae2f1d-3fcf-4325-8357-cdf9473330e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40f7d8f-d6f8-452a-8837-d594cc3898f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:57 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Volume 8957f262-1c50-49c5-83e2-44d02c2ed7a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2', 'volume_size': 1} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:12:57 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170" returned: 0 in 0.622s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:12:57 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Converted 1024.00 MB image at 195.73 MB/s Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] f254caaa-d033-474e-a087-191f1c363076 was raw, converting to qcow2 {{(pid=87582) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 03 20:12:57 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 1G" returned: 0 in 0.401s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Downloaded image 2f677e69-c223-4c71-b630-2245f346f65e ((None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}])) to volume 04098dac-14f1-4ea9-b679-070b74c3b107 successfully. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Temporary image 2f677e69-c223-4c71-b630-2245f346f65e for user b64369132a9548379f50371c6efab192 is deleted. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Marking volume 04098dac-14f1-4ea9-b679-070b74c3b107 as bootable. {{(pid=87582) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7698f07-717d-4cc5-835a-795ed89df808]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Copying metadata from image 2f677e69-c223-4c71-b630-2245f346f65e to 04098dac-14f1-4ea9-b679-070b74c3b107. {{(pid=87582) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 20:12:57 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Creating volume glance metadata for volume 04098dac-14f1-4ea9-b679-070b74c3b107 backed by image 2f677e69-c223-4c71-b630-2245f346f65e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87582) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 20:12:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b085225b-41b8-48d8-a083-bc8b97fbd330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04098dac-14f1-4ea9-b679-070b74c3b107', 'volume_size': 1, 'image_id': '2f677e69-c223-4c71-b630-2245f346f65e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f677e69-c223-4c71-b630-2245f346f65e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd6b5e50bbb54250b4a2302a0a530613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f677e69-c223-4c71-b630-2245f346f65e', 'created_at': datetime.datetime(2026, 9, 3, 17, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 17, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f677e69-c223-4c71-b630-2245f346f65e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267a60c4-bfb9-4c28-abb6-fa5e2d7123f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:12:58 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img Sep 03 20:12:58 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:58 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Volume volume-04098dac-14f1-4ea9-b679-070b74c3b107 (04098dac-14f1-4ea9-b679-070b74c3b107): created successfully Sep 03 20:12:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267a60c4-bfb9-4c28-abb6-fa5e2d7123f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:12:58 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Flow 'volume_create_manager' (cf41e57f-601c-4d8b-b9a6-a7fff70be3d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:12:58 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a0996788-222e-42d1-9771-723dd3a89b7d tempest-TestShelveInstance-2106554556 None] Created volume successfully. Sep 03 20:12:58 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img" returned: 0 in 0.332s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:58 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img Sep 03 20:12:58 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:58 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img" returned: 1 in 0.335s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:12:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img /opt/stack/data/cinder/conversion/vol_upload_gdmv8_sm {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:58 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img /opt/stack/data/cinder/conversion/vol_upload_gdmv8_sm Sep 03 20:12:58 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:58 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img /opt/stack/data/cinder/conversion/vol_upload_gdmv8_sm" returned: 0 in 0.282s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:12:58 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Image conversion details: src /opt/stack/data/cinder/conversion/f0cedd85-bcb7-4238-9967-88bab96e4170.temp_image.f254caaa-d033-474e-a087-191f1c363076fx6ok08c.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_gdmv8_sm {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:12:58 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 03 20:12:58 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfaf807-13af-4d18-b086-d272ab1dc207]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:12:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gdmv8_sm {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:12:58 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gdmv8_sm Sep 03 20:12:58 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:12:59 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 03 20:12:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gdmv8_sm" returned: 0 in 0.363s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.485s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Uploaded volume to glance image-id: f254caaa-d033-474e-a087-191f1c363076. {{(pid=87582) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 20:13:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.781s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] Creating offline snapshot a03cb844-8240-4fef-b182-bb5bec37b6fc of volume 68ab7e30-4c22-4c1e-8239-55e033e2dba8 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:13:01 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-38f59305-0c35-4f48-8e07-b8c5884261d4 tempest-VolumesActionsTest-209483103 None] Copy volume to image completed successfully. Sep 03 20:13:01 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec0a2df-f634-48e5-8690-ad0f40b8c165]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:01 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 Sep 03 20:13:01 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-15aed19d-7df9-49d2-b686-1e354dc4ef57 req-4c1b53f9-f2c6-4f8a-b460-113622795f7e tempest-TestShelveInstance-2106554556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:02 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8" returned: 0 in 0.488s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:02 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc 1G Sep 03 20:13:02 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:02 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc 1G" returned: 0 in 0.592s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:02 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc Sep 03 20:13:02 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:03 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc" returned: 0 in 0.413s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:03 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc is being set with open permissions: ugo+rw Sep 03 20:13:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:03 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc Sep 03 20:13:03 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Acquiring lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Acquiring lock "cinder-quobyte-f0cedd85-bcb7-4238-9967-88bab96e4170" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Lock "cinder-quobyte-f0cedd85-bcb7-4238-9967-88bab96e4170" acquired by "delete_volume" :: waited 0.039s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:03 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc" returned: 0 in 0.459s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:03 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3956b22c-63f9-48bb-9a28-c856e0d825d5]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:03 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.info Sep 03 20:13:03 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:03 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 Sep 03 20:13:03 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:03 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.info" returned: 0 in 0.385s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:03 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.info is being set with open permissions: ugo+rw Sep 03 20:13:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:04 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.info Sep 03 20:13:04 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:04 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170" returned: 0 in 0.700s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:04 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170 Sep 03 20:13:04 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:04 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.info" returned: 0 in 0.599s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.116s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.900s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1590965803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8957f262-1c50-49c5-83e2-44d02c2ed7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b489fad0e5914dc29fe47a407e939e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:12:58Z,use_quota=True,user_id='d7da25653423451bb8e55a3857634402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Creating volume 8957f262-1c50-49c5-83e2-44d02c2ed7a2 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:13:04 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:04 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f0cedd85-bcb7-4238-9967-88bab96e4170" returned: 0 in 0.536s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:04 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 1073741824 Sep 03 20:13:04 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Lock "cinder-quobyte-f0cedd85-bcb7-4238-9967-88bab96e4170" released by "delete_volume" :: held 1.326s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:04 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-eb67eaba-c942-4897-8c9d-f2a3aced7ada tempest-VolumesSnapshotTestJSON-882480365 None] Create snapshot completed successfully Sep 03 20:13:05 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Created reservations ['20f221ba-c1e8-4a02-a30e-2f0a96841cf8', '44b6d438-7b70-4072-8a3c-39f5fc5a726f', '65c6bf10-1888-43d3-b37c-98311aac0864', '2f3d1f7c-45b7-4e58-bc0e-dc24814d86e3'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:13:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:05 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:13:05 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:05 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.389s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:05 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:13:05 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Deleted volume successfully. Sep 03 20:13:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3760010c-227b-467d-b201-bcd0d1f01f24 tempest-VolumesActionsTest-209483103 None] Lock "cinder-f0cedd85-bcb7-4238-9967-88bab96e4170-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:05 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 1073741824" returned: 0 in 0.945s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:05 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 Sep 03 20:13:05 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:06 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2" returned: 0 in 0.365s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-15aed19d-7df9-49d2-b686-1e354dc4ef57 req-4c1b53f9-f2c6-4f8a-b460-113622795f7e tempest-TestShelveInstance-2106554556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.127s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40f7d8f-d6f8-452a-8837-d594cc3898f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194e34c5-fb2e-4756-9680-4d0c9b719677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-15aed19d-7df9-49d2-b686-1e354dc4ef57 req-4c1b53f9-f2c6-4f8a-b460-113622795f7e tempest-TestShelveInstance-2106554556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.134s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:06 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Volume volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 (8957f262-1c50-49c5-83e2-44d02c2ed7a2): created successfully Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194e34c5-fb2e-4756-9680-4d0c9b719677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Flow 'volume_create_manager' (4ce516ce-e970-40ab-b776-c6d86395049d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:13:06 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2899c5a7-152f-4d85-8a98-3c6c89f37251 tempest-TestStampPattern-813740280 None] Created volume successfully. Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-15aed19d-7df9-49d2-b686-1e354dc4ef57 req-4c1b53f9-f2c6-4f8a-b460-113622795f7e tempest-TestShelveInstance-2106554556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-04098dac-14f1-4ea9-b679-070b74c3b107', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '862ea1d9-018e-4a32-87d5-4f623bf4b557', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-a03cb844-8240-4fef-b182-bb5bec37b6fc-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-a03cb844-8240-4fef-b182-bb5bec37b6fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:06 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-15aed19d-7df9-49d2-b686-1e354dc4ef57 req-4c1b53f9-f2c6-4f8a-b460-113622795f7e tempest-TestShelveInstance-2106554556 None] attachment_update completed successfully. Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-68ab7e30-4c22-4c1e-8239-55e033e2dba8" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-68ab7e30-4c22-4c1e-8239-55e033e2dba8" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-a03cb844-8240-4fef-b182-bb5bec37b6fc" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-a03cb844-8240-4fef-b182-bb5bec37b6fc" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Deleting offline snapshot a03cb844-8240-4fef-b182-bb5bec37b6fc of volume 68ab7e30-4c22-4c1e-8239-55e033e2dba8 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] snapshot_file for this snap is: volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8cfc94-d04f-4a6b-a837-ee40cf1416d7]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:06 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc Sep 03 20:13:06 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:07 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc" returned: 0 in 0.676s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:07 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:13:07 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f030c3b-aec3-42f7-bf3b-c69cfb0c72d6]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:07 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 Sep 03 20:13:07 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:08 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8" returned: 0 in 0.734s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:08 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc Sep 03 20:13:08 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:09 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc" returned: 0 in 0.868s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:09 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc Sep 03 20:13:09 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:09 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8.a03cb844-8240-4fef-b182-bb5bec37b6fc" returned: 0 in 0.602s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-a03cb844-8240-4fef-b182-bb5bec37b6fc" released by "_delete_snapshot" :: held 3.149s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-68ab7e30-4c22-4c1e-8239-55e033e2dba8" released by "delete_snapshot" :: held 3.201s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:09 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Created reservations ['7c165f21-3ff9-4227-9f9f-cb780b2e0738', '6e7c16e1-8cf3-490c-991f-b8bfc9aa23c8', 'cc45a10b-05ba-4a8e-9af1-6dc10116ef4b', '2e4fd03f-3505-4431-865c-fb4bb3adcbb1'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:13:10 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Delete snapshot completed successfully. Sep 03 20:13:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b4ba8503-a1fb-4f18-9d4d-d8d91681cb73 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-a03cb844-8240-4fef-b182-bb5bec37b6fc-delete_snapshot" released by "delete_snapshot" :: held 3.635s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Flow 'volume_create_manager' (ee8f2817-55d8-4c8e-a642-c9b0def7d15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3389a199-7534-4d3c-bc88-c45219402133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3389a199-7534-4d3c-bc88-c45219402133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1768630406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc73cd0-c662-49b3-8d1b-80754239ebb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88243f82b60e4f00b25483b9fb825fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:13:12Z,use_quota=True,user_id='78a7639d6cc6443a949c63271bb02328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aea6c18-5ad8-4dec-9173-c51c0790df5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aea6c18-5ad8-4dec-9173-c51c0790df5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6d36c0-72be-49b6-b70b-876a9d89bdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6d36c0-72be-49b6-b70b-876a9d89bdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc73cd0-c662-49b3-8d1b-80754239ebb3', 'volume_name': 'volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c16e701-beae-43d8-8f4a-24cfe72af91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c16e701-beae-43d8-8f4a-24cfe72af91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2558581-db60-4b50-842f-763ab8543a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:12 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Volume bdc73cd0-c662-49b3-8d1b-80754239ebb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3', 'volume_size': 1} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1768630406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc73cd0-c662-49b3-8d1b-80754239ebb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88243f82b60e4f00b25483b9fb825fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:13:12Z,use_quota=True,user_id='78a7639d6cc6443a949c63271bb02328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Creating volume bdc73cd0-c662-49b3-8d1b-80754239ebb3 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:13:12 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:13:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:12 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 1073741824 Sep 03 20:13:12 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:13 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 1073741824" returned: 0 in 1.016s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:13 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 Sep 03 20:13:13 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:13 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3" returned: 0 in 0.351s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:13:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2558581-db60-4b50-842f-763ab8543a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6df2bfd-f0c0-4414-adfe-1db2375af8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:13 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Volume volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 (bdc73cd0-c662-49b3-8d1b-80754239ebb3): created successfully Sep 03 20:13:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6df2bfd-f0c0-4414-adfe-1db2375af8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Flow 'volume_create_manager' (ee8f2817-55d8-4c8e-a642-c9b0def7d15e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:13:14 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b8d07e11-ecd1-46aa-92dc-4cc6802130e4 tempest-VolumesSnapshotTestJSON-882480365 None] Created volume successfully. Sep 03 20:13:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] Creating offline snapshot bf222635-89ec-4663-84ca-8ecfbb3b8fc4 of volume bdc73cd0-c662-49b3-8d1b-80754239ebb3 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:13:14 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f9f850-e703-46b5-8701-6e49b238012b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:14 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 Sep 03 20:13:14 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:15 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3" returned: 0 in 0.878s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:15 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 1G Sep 03 20:13:15 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:16 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 1G" returned: 0 in 0.978s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:16 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 Sep 03 20:13:16 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:17 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4" returned: 0 in 0.702s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:17 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 is being set with open permissions: ugo+rw Sep 03 20:13:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:17 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 Sep 03 20:13:17 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:18 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4" returned: 0 in 0.735s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:18 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.info Sep 03 20:13:18 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:18 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.info" returned: 0 in 0.767s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:18 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.info is being set with open permissions: ugo+rw Sep 03 20:13:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:19 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.info Sep 03 20:13:19 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:19 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.info" returned: 0 in 0.474s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.833s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:19 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-80a22790-ad14-4bde-9e48-885ac5c40a39 tempest-VolumesSnapshotTestJSON-882480365 None] Create snapshot completed successfully Sep 03 20:13:20 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Flow 'volume_create_manager' (bdbaa10d-e874-44f3-ad5e-357dafac0bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2c6780-e27a-47bf-b7aa-a3596669d9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2c6780-e27a-47bf-b7aa-a3596669d9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1829944006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8111527-0958-4dd5-97d4-ca40373f2c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88243f82b60e4f00b25483b9fb825fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:13:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=bf222635-89ec-4663-84ca-8ecfbb3b8fc4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:13:21Z,use_quota=True,user_id='78a7639d6cc6443a949c63271bb02328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fd240b-624a-45b6-bd89-ba0e8845c5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fd240b-624a-45b6-bd89-ba0e8845c5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c60a7e8-8a84-4764-9734-1858503fa458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c60a7e8-8a84-4764-9734-1858503fa458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f8111527-0958-4dd5-97d4-ca40373f2c55', 'volume_name': 'volume-f8111527-0958-4dd5-97d4-ca40373f2c55', 'volume_size': 2, 'snapshot_id': 'bf222635-89ec-4663-84ca-8ecfbb3b8fc4'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0eb716-e7b3-4ae4-9475-30c1588c3c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0eb716-e7b3-4ae4-9475-30c1588c3c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a51664c-b460-43fb-a47d-e2998b0dac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:21 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Volume f8111527-0958-4dd5-97d4-ca40373f2c55: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f8111527-0958-4dd5-97d4-ca40373f2c55', 'volume_size': 2, 'snapshot_id': 'bf222635-89ec-4663-84ca-8ecfbb3b8fc4'} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-bf222635-89ec-4663-84ca-8ecfbb3b8fc4-f8111527-0958-4dd5-97d4-ca40373f2c55" by "_create_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-bf222635-89ec-4663-84ca-8ecfbb3b8fc4-f8111527-0958-4dd5-97d4-ca40373f2c55" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Creating volume f8111527-0958-4dd5-97d4-ca40373f2c55 from snapshot bf222635-89ec-4663-84ca-8ecfbb3b8fc4 {{(pid=87582) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-f8111527-0958-4dd5-97d4-ca40373f2c55" by "_copy_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-f8111527-0958-4dd5-97d4-ca40373f2c55" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] snapshot: bf222635-89ec-4663-84ca-8ecfbb3b8fc4, volume: f8111527-0958-4dd5-97d4-ca40373f2c55, {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[601815ef-ee5c-43e6-911b-394dde3d7112]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:21 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 Sep 03 20:13:21 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:21 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Flow 'volume_create_manager' (483de37a-2adf-42c6-a068-828a0a8a9315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a8efb2-9ab5-4258-a262-a943809fe346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4" returned: 0 in 0.484s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a8efb2-9ab5-4258-a262-a943809fe346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1600489854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9193bd27634ff6b514f10d42bdcacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:13:22Z,use_quota=True,user_id='649290f3ade24eda87ffea4cd5e611a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a40c3104-ef84-4059-b525-1a97ee909ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a40c3104-ef84-4059-b525-1a97ee909ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16be1805-328b-469c-904d-2fb6c9590032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16be1805-328b-469c-904d-2fb6c9590032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0', 'volume_name': 'volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d30a96-8026-4d8a-8191-0d800ef97f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d30a96-8026-4d8a-8191-0d800ef97f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dc965d-d03c-4b85-8669-ccd35c5c2e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:21 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Volume bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0', 'volume_size': 1} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a020cb-a199-46bf-84d1-50a0e3589d7f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:21 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 Sep 03 20:13:21 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:22 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3" returned: 0 in 0.368s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 20:13:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Creating direct copy from snapshot {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 20:13:22 devstack cinder-volume[87582]: DEBUG cinder.utils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Path /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55 not found in is_blk_device check {{(pid=87582) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 20:13:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:22 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55 Sep 03 20:13:22 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55" returned: 0 in 5.593s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:27 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:13:27 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Converted 1024.00 MB image at 183.01 MB/s Sep 03 20:13:27 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55 is being set with open permissions: ugo+rw Sep 03 20:13:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:27 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55 Sep 03 20:13:27 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:28 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55" returned: 0 in 0.290s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-f8111527-0958-4dd5-97d4-ca40373f2c55" released by "_copy_volume_from_snapshot" :: held 6.869s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-bf222635-89ec-4663-84ca-8ecfbb3b8fc4-f8111527-0958-4dd5-97d4-ca40373f2c55" released by "_create_volume_from_snapshot" :: held 6.954s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.971s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.325s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1600489854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9193bd27634ff6b514f10d42bdcacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:13:22Z,use_quota=True,user_id='649290f3ade24eda87ffea4cd5e611a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Creating volume bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:13:28 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:28 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0 1073741824 Sep 03 20:13:28 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a51664c-b460-43fb-a47d-e2998b0dac55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8111527-0958-4dd5-97d4-ca40373f2c55', 'volume_size': 2, 'snapshot_id': 'bf222635-89ec-4663-84ca-8ecfbb3b8fc4'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358764f6-3224-48d9-bd98-a6f4786361a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:28 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Volume volume-f8111527-0958-4dd5-97d4-ca40373f2c55 (f8111527-0958-4dd5-97d4-ca40373f2c55): created successfully Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358764f6-3224-48d9-bd98-a6f4786361a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Flow 'volume_create_manager' (bdbaa10d-e874-44f3-ad5e-357dafac0bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:13:28 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-90746fc4-dc43-4b0b-a767-68f7237b4d9c tempest-VolumesSnapshotTestJSON-882480365 None] Created volume successfully. Sep 03 20:13:28 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0 1073741824" returned: 0 in 0.566s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:28 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0 Sep 03 20:13:28 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-f8111527-0958-4dd5-97d4-ca40373f2c55-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:29 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-f8111527-0958-4dd5-97d4-ca40373f2c55-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0" returned: 0 in 0.368s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dc965d-d03c-4b85-8669-ccd35c5c2e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdeefc7-b3f3-47e7-b141-2b6b2f9d11a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:29 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Volume volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0 (bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0): created successfully Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdeefc7-b3f3-47e7-b141-2b6b2f9d11a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Flow 'volume_create_manager' (483de37a-2adf-42c6-a068-828a0a8a9315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-f8111527-0958-4dd5-97d4-ca40373f2c55" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:29 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-bd6e4250-e002-4166-9135-d9c2cf3c567b tempest-VolumesNegativeTest-1478420471 None] Created volume successfully. Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-f8111527-0958-4dd5-97d4-ca40373f2c55" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bdac90-6fa1-40d9-9453-f973cc39671e]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:29 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55 Sep 03 20:13:29 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:29 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55" returned: 0 in 0.418s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:29 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55 Sep 03 20:13:29 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:29 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f8111527-0958-4dd5-97d4-ca40373f2c55" returned: 0 in 0.308s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-f8111527-0958-4dd5-97d4-ca40373f2c55" released by "delete_volume" :: held 0.784s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Created reservations ['d1228f2e-ee48-45ef-9b24-bc36ecfe7c68', '914946c8-d793-439e-8591-4d0bfe1367f4', '113bcc07-5d3d-4d83-871e-40a9c019be0e', '94c0b800-0b94-43c0-b921-1d2a61b59a02'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:30 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:13:30 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:30 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-bf222635-89ec-4663-84ca-8ecfbb3b8fc4-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.283s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:13:30 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Deleted volume successfully. Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-bf222635-89ec-4663-84ca-8ecfbb3b8fc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-bdc73cd0-c662-49b3-8d1b-80754239ebb3" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7f6ee30c-0cf0-486c-b33f-ebd45f777969 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-f8111527-0958-4dd5-97d4-ca40373f2c55-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-bdc73cd0-c662-49b3-8d1b-80754239ebb3" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-bf222635-89ec-4663-84ca-8ecfbb3b8fc4" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-bf222635-89ec-4663-84ca-8ecfbb3b8fc4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Deleting offline snapshot bf222635-89ec-4663-84ca-8ecfbb3b8fc4 of volume bdc73cd0-c662-49b3-8d1b-80754239ebb3 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] snapshot_file for this snap is: volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7155988-9b8c-449f-a607-cce99eabb6a5]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:30 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 Sep 03 20:13:30 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:30 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4" returned: 0 in 0.385s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5c3249-1625-46db-b578-792795d3f74d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:31 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 Sep 03 20:13:31 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:31 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3" returned: 0 in 0.592s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:31 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 Sep 03 20:13:31 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:31 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4" returned: 0 in 0.400s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:31 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4 Sep 03 20:13:31 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:32 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3.bf222635-89ec-4663-84ca-8ecfbb3b8fc4" returned: 0 in 0.286s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-bf222635-89ec-4663-84ca-8ecfbb3b8fc4" released by "_delete_snapshot" :: held 1.801s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-bdc73cd0-c662-49b3-8d1b-80754239ebb3" released by "delete_snapshot" :: held 1.834s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:32 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Created reservations ['e0bc8ec6-aa63-4296-abe7-db893d19b18e', 'e99768cf-a668-456d-a21d-80c1eb36d12b', '756bdcb2-bb30-4caf-b408-24346b55054e', '28357138-f980-4663-9bb8-a2cb6bddab65'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:13:32 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Delete snapshot completed successfully. Sep 03 20:13:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b1103cd6-5f81-48ec-91f4-f972050f36f7 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-bf222635-89ec-4663-84ca-8ecfbb3b8fc4-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-bdc73cd0-c662-49b3-8d1b-80754239ebb3-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-bdc73cd0-c662-49b3-8d1b-80754239ebb3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:32 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=65,cinder:UPDATE=52,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:13:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-bdc73cd0-c662-49b3-8d1b-80754239ebb3" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-bdc73cd0-c662-49b3-8d1b-80754239ebb3" acquired by "delete_volume" :: waited 0.040s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:32 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e210a21b-4a24-418c-b40d-f2c558f1cc99]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:33 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 Sep 03 20:13:33 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:33 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3" returned: 0 in 0.463s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:33 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3 Sep 03 20:13:33 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:33 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdc73cd0-c662-49b3-8d1b-80754239ebb3" returned: 0 in 0.271s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-bdc73cd0-c662-49b3-8d1b-80754239ebb3" released by "delete_volume" :: held 0.823s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:33 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Created reservations ['91f86a49-55df-4d39-a297-3ab44dc2e80d', '4697e6e7-8ff9-4797-8429-523db9eb76e3', 'dca4f22a-52b1-448a-92d0-53ee88174511', '0c5bb485-25e3-4434-8969-6318076b4ddd'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:13:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:33 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:13:33 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:34 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.347s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:13:34 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Deleted volume successfully. Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ec92efcd-9e15-4326-9b3a-e8abd6f5e742 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-bdc73cd0-c662-49b3-8d1b-80754239ebb3-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-52280656-4063-4d0a-84de-75a11590d632 req-78d16186-4b93-46c5-bc61-732a8c15e952 tempest-TestStampPattern-813740280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-52280656-4063-4d0a-84de-75a11590d632 req-78d16186-4b93-46c5-bc61-732a8c15e952 tempest-TestStampPattern-813740280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-52280656-4063-4d0a-84de-75a11590d632 req-78d16186-4b93-46c5-bc61-732a8c15e952 tempest-TestStampPattern-813740280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Flow 'volume_create_manager' (93e90b53-e8e0-4e9c-a833-abb180ea3e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6f48b8-8107-4452-b017-a372156088ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6f48b8-8107-4452-b017-a372156088ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1995630139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5691a78f-3d13-463f-94e5-c467610832db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88243f82b60e4f00b25483b9fb825fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:13:35Z,use_quota=True,user_id='78a7639d6cc6443a949c63271bb02328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d034ce-d28c-42e3-8e57-43bccb47a56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d034ce-d28c-42e3-8e57-43bccb47a56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3524d05-207b-4232-bb9f-88af38589f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3524d05-207b-4232-bb9f-88af38589f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5691a78f-3d13-463f-94e5-c467610832db', 'volume_name': 'volume-5691a78f-3d13-463f-94e5-c467610832db', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b508c63e-957c-4929-841c-f1acb1da9c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b508c63e-957c-4929-841c-f1acb1da9c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6761d46e-c305-4cd7-a5bc-499dc1b43dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:34 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Volume 5691a78f-3d13-463f-94e5-c467610832db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5691a78f-3d13-463f-94e5-c467610832db', 'volume_size': 1} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1995630139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5691a78f-3d13-463f-94e5-c467610832db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88243f82b60e4f00b25483b9fb825fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:13:35Z,use_quota=True,user_id='78a7639d6cc6443a949c63271bb02328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Creating volume 5691a78f-3d13-463f-94e5-c467610832db {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:13:34 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:34 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db 1073741824 Sep 03 20:13:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-52280656-4063-4d0a-84de-75a11590d632 req-78d16186-4b93-46c5-bc61-732a8c15e952 tempest-TestStampPattern-813740280 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65956eeb-830c-41bb-a546-f8f5afd3dcac', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:13:34 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:34 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-52280656-4063-4d0a-84de-75a11590d632 req-78d16186-4b93-46c5-bc61-732a8c15e952 tempest-TestStampPattern-813740280 None] attachment_update completed successfully. Sep 03 20:13:35 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db 1073741824" returned: 0 in 0.907s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:35 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db Sep 03 20:13:35 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:36 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db" returned: 0 in 0.462s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6761d46e-c305-4cd7-a5bc-499dc1b43dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5691a78f-3d13-463f-94e5-c467610832db', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890393c0-6cbe-430b-b60b-9de26d61c121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:36 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Volume volume-5691a78f-3d13-463f-94e5-c467610832db (5691a78f-3d13-463f-94e5-c467610832db): created successfully Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890393c0-6cbe-430b-b60b-9de26d61c121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Flow 'volume_create_manager' (93e90b53-e8e0-4e9c-a833-abb180ea3e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:13:36 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-970e9cc2-6f1a-4f5b-90cd-65068398bcee tempest-VolumesSnapshotTestJSON-882480365 None] Created volume successfully. Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:36 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:13:36 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] Creating offline snapshot 502ac3d4-be38-4993-aa75-fa4b02fee474 of volume 5691a78f-3d13-463f-94e5-c467610832db {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:13:37 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.478s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:13:37 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[426d7e7b-be22-4e26-8fe5-a49601234e13]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:13:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 28 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:13:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:13:37 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db Sep 03 20:13:37 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:37 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db" returned: 0 in 0.657s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:37 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 1G Sep 03 20:13:37 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:38 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 1G" returned: 0 in 0.469s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5691a78f-3d13-463f-94e5-c467610832db -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:38 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5691a78f-3d13-463f-94e5-c467610832db -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 Sep 03 20:13:38 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:38 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5691a78f-3d13-463f-94e5-c467610832db -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474" returned: 0 in 0.450s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:38 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 is being set with open permissions: ugo+rw Sep 03 20:13:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:38 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 Sep 03 20:13:38 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:39 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474" returned: 0 in 0.329s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:39 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=81,cinder:UPDATE=69,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:13:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:39 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.info Sep 03 20:13:39 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:39 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.info" returned: 0 in 0.456s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:39 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.info is being set with open permissions: ugo+rw Sep 03 20:13:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:39 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.info Sep 03 20:13:39 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:40 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.info" returned: 0 in 0.496s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.082s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:40 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-92333cc1-6059-4d6c-a996-ca3e474fe524 tempest-VolumesSnapshotTestJSON-882480365 None] Create snapshot completed successfully Sep 03 20:13:41 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-53bb3fd1-3b09-495f-bde6-e1b20c886140 req-8039bfd0-cf1a-427a-b2d2-b7461b6cb6b9 tempest-TestStampPattern-813740280 None] Terminate volume connection completed successfully. Sep 03 20:13:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-53bb3fd1-3b09-495f-bde6-e1b20c886140 req-8039bfd0-cf1a-427a-b2d2-b7461b6cb6b9 tempest-TestStampPattern-813740280 None] Deleting attachment 65956eeb-830c-41bb-a546-f8f5afd3dcac. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Flow 'volume_create_manager' (6b7de685-5421-48f5-8bdd-843b71fc7de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36135a78-27a7-4ddc-8bf6-a5d77f303234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36135a78-27a7-4ddc-8bf6-a5d77f303234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1718621703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fe026c-1295-4a29-a391-64a2613c1655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88243f82b60e4f00b25483b9fb825fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=502ac3d4-be38-4993-aa75-fa4b02fee474,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:13:42Z,use_quota=True,user_id='78a7639d6cc6443a949c63271bb02328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e38a5d2-7a95-41b9-889d-a17922c14c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e38a5d2-7a95-41b9-889d-a17922c14c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00145502-7c07-4d5d-baf6-9f05e37adab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00145502-7c07-4d5d-baf6-9f05e37adab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '70fe026c-1295-4a29-a391-64a2613c1655', 'volume_name': 'volume-70fe026c-1295-4a29-a391-64a2613c1655', 'volume_size': 1, 'snapshot_id': '502ac3d4-be38-4993-aa75-fa4b02fee474'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0966c026-c11c-4f0e-8a6f-9765dadefd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0966c026-c11c-4f0e-8a6f-9765dadefd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b097f9-8831-4c7c-8560-cdeb486d5815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:42 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Volume 70fe026c-1295-4a29-a391-64a2613c1655: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-70fe026c-1295-4a29-a391-64a2613c1655', 'volume_size': 1, 'snapshot_id': '502ac3d4-be38-4993-aa75-fa4b02fee474'} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-502ac3d4-be38-4993-aa75-fa4b02fee474-70fe026c-1295-4a29-a391-64a2613c1655" by "_create_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-502ac3d4-be38-4993-aa75-fa4b02fee474-70fe026c-1295-4a29-a391-64a2613c1655" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Creating volume 70fe026c-1295-4a29-a391-64a2613c1655 from snapshot 502ac3d4-be38-4993-aa75-fa4b02fee474 {{(pid=87582) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-70fe026c-1295-4a29-a391-64a2613c1655" by "_copy_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-70fe026c-1295-4a29-a391-64a2613c1655" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] snapshot: 502ac3d4-be38-4993-aa75-fa4b02fee474, volume: 70fe026c-1295-4a29-a391-64a2613c1655, {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d677028d-8be7-43eb-89d9-32672a2b3422]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:42 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 Sep 03 20:13:42 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:42 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474" returned: 0 in 0.506s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5691a78f-3d13-463f-94e5-c467610832db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6d794e-8d3a-4c3d-8daf-5daefc0020a0]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:42 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db Sep 03 20:13:42 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:43 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db" returned: 0 in 0.620s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 20:13:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Creating direct copy from snapshot {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 20:13:43 devstack cinder-volume[87582]: DEBUG cinder.utils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Path /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655 not found in is_blk_device check {{(pid=87582) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 20:13:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:43 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655 Sep 03 20:13:43 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:43 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-7f926e9d-1978-4f24-a246-6d256412ebba req-d78ff6ee-5e61-4002-b89b-68e362450f10 tempest-TestShelveInstance-2106554556 None] Terminate volume connection completed successfully. Sep 03 20:13:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-7f926e9d-1978-4f24-a246-6d256412ebba req-d78ff6ee-5e61-4002-b89b-68e362450f10 tempest-TestShelveInstance-2106554556 None] Deleting attachment 862ea1d9-018e-4a32-87d5-4f623bf4b557. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:13:49 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655" returned: 0 in 6.255s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:49 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:13:49 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Converted 1024.00 MB image at 163.69 MB/s Sep 03 20:13:49 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655 is being set with open permissions: ugo+rw Sep 03 20:13:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:49 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655 Sep 03 20:13:49 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-07f0ce5f-94e8-49d6-a4dd-3b7333c9ef56 req-fee4ead6-bc8c-4b7e-b16f-d9a43944ad3b tempest-TestShelveInstance-2106554556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:50 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655" returned: 0 in 0.278s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-70fe026c-1295-4a29-a391-64a2613c1655" released by "_copy_volume_from_snapshot" :: held 7.787s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-502ac3d4-be38-4993-aa75-fa4b02fee474-70fe026c-1295-4a29-a391-64a2613c1655" released by "_create_volume_from_snapshot" :: held 7.872s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.889s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.391s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] Creating offline snapshot b89ea654-75c7-47ed-8718-a5b4913f143a of volume 8957f262-1c50-49c5-83e2-44d02c2ed7a2 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b097f9-8831-4c7c-8560-cdeb486d5815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70fe026c-1295-4a29-a391-64a2613c1655', 'volume_size': 1, 'snapshot_id': '502ac3d4-be38-4993-aa75-fa4b02fee474'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35ec732-51fa-4e5c-ad4c-a0f56a534fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[73062749-9967-4c02-a2cf-6f122a1d5864]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:50 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Volume volume-70fe026c-1295-4a29-a391-64a2613c1655 (70fe026c-1295-4a29-a391-64a2613c1655): created successfully Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35ec732-51fa-4e5c-ad4c-a0f56a534fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Flow 'volume_create_manager' (6b7de685-5421-48f5-8bdd-843b71fc7de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:13:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6045b708-74d1-4905-aa8f-3abb7e7cb324 tempest-VolumesSnapshotTestJSON-882480365 None] Created volume successfully. Sep 03 20:13:50 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 Sep 03 20:13:50 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:50 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2" returned: 0 in 0.493s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:50 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a 1G Sep 03 20:13:50 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:51 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a 1G" returned: 0 in 0.529s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:51 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a Sep 03 20:13:51 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-70fe026c-1295-4a29-a391-64a2613c1655-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-70fe026c-1295-4a29-a391-64a2613c1655-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-70fe026c-1295-4a29-a391-64a2613c1655" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-70fe026c-1295-4a29-a391-64a2613c1655" acquired by "delete_volume" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:51 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4e8d62-f282-4e4c-9f8c-0604093ec2ef]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:51 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a" returned: 0 in 0.433s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:51 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a is being set with open permissions: ugo+rw Sep 03 20:13:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:51 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a Sep 03 20:13:51 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:51 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655 Sep 03 20:13:51 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:51 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a" returned: 0 in 0.328s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:52 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.info Sep 03 20:13:52 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:52 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655" returned: 0 in 0.480s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:52 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655 Sep 03 20:13:52 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:52 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.info" returned: 0 in 0.274s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:52 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.info is being set with open permissions: ugo+rw Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:52 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.info Sep 03 20:13:52 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:52 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70fe026c-1295-4a29-a391-64a2613c1655" returned: 0 in 0.261s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-70fe026c-1295-4a29-a391-64a2613c1655" released by "delete_volume" :: held 0.806s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Created reservations ['a8387cbe-528c-449e-b89b-d385456e06c0', '13064d04-0a76-4fed-9f6b-e11a1f1b26fe', 'e0a0ad5a-a9e8-40be-8d25-6bac347dd4cf', '35ff2910-a151-428b-8d43-86c64ec95a2b'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:52 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:13:52 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:52 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.info" returned: 0 in 0.327s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-07f0ce5f-94e8-49d6-a4dd-3b7333c9ef56 req-fee4ead6-bc8c-4b7e-b16f-d9a43944ad3b tempest-TestShelveInstance-2106554556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.786s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-07f0ce5f-94e8-49d6-a4dd-3b7333c9ef56 req-fee4ead6-bc8c-4b7e-b16f-d9a43944ad3b tempest-TestShelveInstance-2106554556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6ca4383d-c78f-46b1-9301-29c4d7c6b15b tempest-TestStampPattern-813740280 None] Create snapshot completed successfully Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-07f0ce5f-94e8-49d6-a4dd-3b7333c9ef56 req-fee4ead6-bc8c-4b7e-b16f-d9a43944ad3b tempest-TestShelveInstance-2106554556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-04098dac-14f1-4ea9-b679-070b74c3b107', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f0040b1-98fc-40c4-a565-7cc256530efb', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:13:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-07f0ce5f-94e8-49d6-a4dd-3b7333c9ef56 req-fee4ead6-bc8c-4b7e-b16f-d9a43944ad3b tempest-TestShelveInstance-2106554556 None] attachment_update completed successfully. Sep 03 20:13:52 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.321s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:13:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Deleted volume successfully. Sep 03 20:13:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-95de5f19-d2fa-4e00-b5af-677a5e50c004 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-70fe026c-1295-4a29-a391-64a2613c1655-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-502ac3d4-be38-4993-aa75-fa4b02fee474-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-502ac3d4-be38-4993-aa75-fa4b02fee474-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-5691a78f-3d13-463f-94e5-c467610832db" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-5691a78f-3d13-463f-94e5-c467610832db" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-502ac3d4-be38-4993-aa75-fa4b02fee474" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-502ac3d4-be38-4993-aa75-fa4b02fee474" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Deleting offline snapshot 502ac3d4-be38-4993-aa75-fa4b02fee474 of volume 5691a78f-3d13-463f-94e5-c467610832db {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] snapshot_file for this snap is: volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b63576a-98c6-4fd5-b226-8f312a6eae6c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:53 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 Sep 03 20:13:53 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:53 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474" returned: 0 in 0.519s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5691a78f-3d13-463f-94e5-c467610832db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f2c24d-e352-44ae-bd06-1406dd042690]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:53 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db Sep 03 20:13:53 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Acquiring lock "cinder-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:54 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db" returned: 0 in 0.828s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Lock "cinder-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:54 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 Sep 03 20:13:54 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Acquiring lock "cinder-quobyte-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Lock "cinder-quobyte-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:54 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0964356d-8ef8-4d8a-a8ef-cad57f749258]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:54 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0 Sep 03 20:13:54 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:55 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474" returned: 0 in 0.504s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:55 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474 Sep 03 20:13:55 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:55 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0" returned: 0 in 0.522s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:55 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0 Sep 03 20:13:55 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:55 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db.502ac3d4-be38-4993-aa75-fa4b02fee474" returned: 0 in 0.321s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-502ac3d4-be38-4993-aa75-fa4b02fee474" released by "_delete_snapshot" :: held 2.348s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-5691a78f-3d13-463f-94e5-c467610832db" released by "delete_snapshot" :: held 2.391s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Created reservations ['a1bd51ec-1b87-44b9-bf4d-eb934d8e1d92', 'ef1721a7-cd9c-41fe-9c45-af434c90b896', '72a0d528-0dc1-4311-a4e9-f15a7cede6b4', 'b3d895ca-3295-44ce-bcda-0d36dc3ff149'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:13:55 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0" returned: 0 in 0.409s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Lock "cinder-quobyte-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0" released by "delete_volume" :: held 0.992s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:55 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Delete snapshot completed successfully. Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6042e762-9437-4716-bf2f-bf69aca232e7 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-502ac3d4-be38-4993-aa75-fa4b02fee474-delete_snapshot" released by "delete_snapshot" :: held 2.644s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Created reservations ['08c23b14-f5fd-4eae-92dd-8f8cbadcf1b1', '47609b54-5534-4c2c-ae9e-0404d60b8f83', '44119547-17dd-41d5-adc9-3ecb072bcff9', '72032428-0a7e-447a-b731-68636b049e7c'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:55 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:13:55 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:56 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.289s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:56 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:13:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Deleted volume successfully. Sep 03 20:13:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-78170bca-e36a-49b7-ae9b-2278f4407d71 tempest-VolumesNegativeTest-1478420471 None] Lock "cinder-bdad255f-6f96-4a4d-b6e7-32d38f1d7bc0-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-5691a78f-3d13-463f-94e5-c467610832db-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-5691a78f-3d13-463f-94e5-c467610832db-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-5691a78f-3d13-463f-94e5-c467610832db" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-5691a78f-3d13-463f-94e5-c467610832db" acquired by "delete_volume" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:56 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[099f207a-bcf3-4c40-ad59-41de50871e0f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:56 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db Sep 03 20:13:56 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:57 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db" returned: 0 in 0.709s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:57 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db Sep 03 20:13:57 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:57 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5691a78f-3d13-463f-94e5-c467610832db" returned: 0 in 0.646s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-5691a78f-3d13-463f-94e5-c467610832db" released by "delete_volume" :: held 1.445s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:58 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Created reservations ['849c0508-1d51-46f2-aae0-ecca44d5f80c', 'd052e3be-1775-4eb0-bc6f-ba97c369c592', '61a4d8fa-a62f-442b-b278-493784018c5a', '571a652a-ad26-474e-a520-7c6a521e17fe'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:13:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:13:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:13:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:13:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:13:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:13:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:58 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:13:58 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:58 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.353s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:58 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:13:58 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Deleted volume successfully. Sep 03 20:13:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c8c25ca6-17b8-45e5-87af-33ba617ef398 tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-5691a78f-3d13-463f-94e5-c467610832db-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:13:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-68ab7e30-4c22-4c1e-8239-55e033e2dba8-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-68ab7e30-4c22-4c1e-8239-55e033e2dba8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "cinder-quobyte-68ab7e30-4c22-4c1e-8239-55e033e2dba8" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:13:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-68ab7e30-4c22-4c1e-8239-55e033e2dba8" acquired by "delete_volume" :: waited 0.048s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:13:59 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd7e5b4-d051-42f1-abb4-267aa9f92e2f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:13:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:59 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 Sep 03 20:13:59 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:13:59 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Sep 03 20:13:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8" returned: 0 in 0.484s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:13:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:13:59 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8 Sep 03 20:13:59 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:00 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68ab7e30-4c22-4c1e-8239-55e033e2dba8" returned: 0 in 0.353s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-quobyte-68ab7e30-4c22-4c1e-8239-55e033e2dba8" released by "delete_volume" :: held 0.973s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:14:00 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Created reservations ['5428c2fc-40a4-4dcc-9b35-3a8ee722f21e', 'ab6a8459-1b49-45be-9186-c03131792322', '865fa63f-3e58-4bc9-af7f-9ce7bff078af', '5295eb0f-b9cb-4f18-a0c9-3c1151dd7259'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:14:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:14:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:14:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:00 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:14:00 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:00 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.480s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:00 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:14:00 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Deleted volume successfully. Sep 03 20:14:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6edd1ea6-beec-49b1-a33d-adf8f1ca6b4b tempest-VolumesSnapshotTestJSON-882480365 None] Lock "cinder-68ab7e30-4c22-4c1e-8239-55e033e2dba8-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Flow 'volume_create_manager' (75cc5553-9b7e-4882-857e-a7d7b27cf1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb996ca5-8470-4e52-9a4f-e059e7777492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb996ca5-8470-4e52-9a4f-e059e7777492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1709471291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ee6886-ed43-4d0d-9db8-c301803a49f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='538acbadd94149828c8a7821de513851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:14:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:14:02Z,use_quota=True,user_id='184a648e92e546df9f9c06267891fe2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d709a6-0490-4305-94fa-f03d17e49957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d709a6-0490-4305-94fa-f03d17e49957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69665dc4-9d89-4426-98e7-e045aab61d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69665dc4-9d89-4426-98e7-e045aab61d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ee6886-ed43-4d0d-9db8-c301803a49f3', 'volume_name': 'volume-04ee6886-ed43-4d0d-9db8-c301803a49f3', 'volume_size': 2}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a472fe-3dea-4630-91b2-1ab6a801f899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a472fe-3dea-4630-91b2-1ab6a801f899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbc3d18-afe5-4515-9119-47ed7e5b3942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:02 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Volume 04ee6886-ed43-4d0d-9db8-c301803a49f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ee6886-ed43-4d0d-9db8-c301803a49f3', 'volume_size': 2} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1709471291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ee6886-ed43-4d0d-9db8-c301803a49f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='538acbadd94149828c8a7821de513851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:14:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:14:02Z,use_quota=True,user_id='184a648e92e546df9f9c06267891fe2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Creating volume 04ee6886-ed43-4d0d-9db8-c301803a49f3 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:14:02 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:14:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 2147483648 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:02 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 2147483648 Sep 03 20:14:02 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:03 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 2147483648" returned: 0 in 0.642s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:03 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 Sep 03 20:14:03 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:03 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3" returned: 0 in 0.319s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:14:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbc3d18-afe5-4515-9119-47ed7e5b3942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ee6886-ed43-4d0d-9db8-c301803a49f3', 'volume_size': 2}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000091f1-8d63-4a89-a5b3-5dfc4f3979d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:03 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Volume volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 (04ee6886-ed43-4d0d-9db8-c301803a49f3): created successfully Sep 03 20:14:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000091f1-8d63-4a89-a5b3-5dfc4f3979d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Flow 'volume_create_manager' (75cc5553-9b7e-4882-857e-a7d7b27cf1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:14:03 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-416db5b6-3463-4101-8be6-97c717d4a25a tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Created volume successfully. Sep 03 20:14:04 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:14:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Flow 'volume_create_manager' (c75d3085-263c-4587-b6b5-131bca45fdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:14:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a67473-296c-42a7-b816-25e9e7a2056b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a67473-296c-42a7-b816-25e9e7a2056b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1692821379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612afe83-f985-4e2c-8d7b-63f520194154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b489fad0e5914dc29fe47a407e939e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b89ea654-75c7-47ed-8718-a5b4913f143a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:14:05Z,use_quota=True,user_id='d7da25653423451bb8e55a3857634402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2add6846-6331-42bd-b5d7-5bcc8113b109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2add6846-6331-42bd-b5d7-5bcc8113b109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfc733b-99d4-44c4-81b7-08767749192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfc733b-99d4-44c4-81b7-08767749192c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '612afe83-f985-4e2c-8d7b-63f520194154', 'volume_name': 'volume-612afe83-f985-4e2c-8d7b-63f520194154', 'volume_size': 1, 'snapshot_id': 'b89ea654-75c7-47ed-8718-a5b4913f143a'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2df18a-7700-44f8-b998-c886841d47bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2df18a-7700-44f8-b998-c886841d47bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa951d04-a066-43d0-8061-db024c4c3650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:05 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Volume 612afe83-f985-4e2c-8d7b-63f520194154: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-612afe83-f985-4e2c-8d7b-63f520194154', 'volume_size': 1, 'snapshot_id': 'b89ea654-75c7-47ed-8718-a5b4913f143a'} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Acquiring lock "cinder-quobyte-b89ea654-75c7-47ed-8718-a5b4913f143a-612afe83-f985-4e2c-8d7b-63f520194154" by "_create_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Lock "cinder-quobyte-b89ea654-75c7-47ed-8718-a5b4913f143a-612afe83-f985-4e2c-8d7b-63f520194154" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Creating volume 612afe83-f985-4e2c-8d7b-63f520194154 from snapshot b89ea654-75c7-47ed-8718-a5b4913f143a {{(pid=87582) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Acquiring lock "cinder-quobyte-612afe83-f985-4e2c-8d7b-63f520194154" by "_copy_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Lock "cinder-quobyte-612afe83-f985-4e2c-8d7b-63f520194154" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] snapshot: b89ea654-75c7-47ed-8718-a5b4913f143a, volume: 612afe83-f985-4e2c-8d7b-63f520194154, {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a9e2de-fdcc-466d-b882-2f54f60480b1]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:05 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a Sep 03 20:14:05 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:05 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a" returned: 0 in 0.470s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59c46a3-bd54-412f-a213-00ae14fc9354]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:14:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:05 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 Sep 03 20:14:05 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:06 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2" returned: 0 in 0.420s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 20:14:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Creating direct copy from snapshot {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 20:14:06 devstack cinder-volume[87582]: DEBUG cinder.utils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Path /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154 not found in is_blk_device check {{(pid=87582) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 20:14:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:06 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154 Sep 03 20:14:06 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=61,cinder:INSERT=19,cinder:UPDATE=48,cinder:DELETE=5 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=46,cinder:UPDATE=59,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:14:15 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154" returned: 0 in 9.042s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2, size 1024.00 MB, duration 9.04 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:14:15 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Converted 1024.00 MB image at 113.24 MB/s Sep 03 20:14:15 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154 is being set with open permissions: ugo+rw Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:15 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154 Sep 03 20:14:15 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:15 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154" returned: 0 in 0.450s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Lock "cinder-quobyte-612afe83-f985-4e2c-8d7b-63f520194154" released by "_copy_volume_from_snapshot" :: held 10.494s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Lock "cinder-quobyte-b89ea654-75c7-47ed-8718-a5b4913f143a-612afe83-f985-4e2c-8d7b-63f520194154" released by "_create_volume_from_snapshot" :: held 10.587s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.614s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.577s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Creating offline snapshot a5fdfb5c-9814-4016-8d58-18ed7fa6a391 of volume 04ee6886-ed43-4d0d-9db8-c301803a49f3 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa951d04-a066-43d0-8061-db024c4c3650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612afe83-f985-4e2c-8d7b-63f520194154', 'volume_size': 1, 'snapshot_id': 'b89ea654-75c7-47ed-8718-a5b4913f143a'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a939b358-5e5d-46c5-baab-82c5fc7db110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6620d5d8-0746-472c-9ada-e5529db6977b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:15 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Volume volume-612afe83-f985-4e2c-8d7b-63f520194154 (612afe83-f985-4e2c-8d7b-63f520194154): created successfully Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a939b358-5e5d-46c5-baab-82c5fc7db110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Flow 'volume_create_manager' (c75d3085-263c-4587-b6b5-131bca45fdf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:14:15 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-fe212cf7-5ccb-45d9-936b-f8c42c86e057 tempest-TestStampPattern-813740280 None] Created volume successfully. Sep 03 20:14:15 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 Sep 03 20:14:15 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:16 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3" returned: 0 in 0.534s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 2G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:16 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 2G Sep 03 20:14:16 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:16 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 2G" returned: 0 in 0.597s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:16 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 Sep 03 20:14:16 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:17 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391" returned: 0 in 0.438s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:17 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 is being set with open permissions: ugo+rw Sep 03 20:14:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:17 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 Sep 03 20:14:17 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:17 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391" returned: 0 in 0.594s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:18 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.info Sep 03 20:14:18 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:18 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.info" returned: 0 in 0.450s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:18 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.info is being set with open permissions: ugo+rw Sep 03 20:14:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:18 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.info Sep 03 20:14:18 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:18 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.info" returned: 0 in 0.416s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.260s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:19 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-aba7feca-5819-478b-8685-79ff66fa9491 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Create snapshot completed successfully Sep 03 20:14:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Acquiring lock "cinder-a5fdfb5c-9814-4016-8d58-18ed7fa6a391-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:14:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "cinder-a5fdfb5c-9814-4016-8d58-18ed7fa6a391-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:14:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Acquiring lock "cinder-quobyte-04ee6886-ed43-4d0d-9db8-c301803a49f3" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:14:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "cinder-quobyte-04ee6886-ed43-4d0d-9db8-c301803a49f3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:14:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Acquiring lock "cinder-quobyte-a5fdfb5c-9814-4016-8d58-18ed7fa6a391" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:14:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "cinder-quobyte-a5fdfb5c-9814-4016-8d58-18ed7fa6a391" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:14:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Deleting offline snapshot a5fdfb5c-9814-4016-8d58-18ed7fa6a391 of volume 04ee6886-ed43-4d0d-9db8-c301803a49f3 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:14:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] snapshot_file for this snap is: volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:14:19 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[642256f9-6b6f-4e46-876f-c32ad95cb5ad]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:14:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:19 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 Sep 03 20:14:19 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:20 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391" returned: 0 in 0.463s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04ee6886-ed43-4d0d-9db8-c301803a49f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:14:20 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe069f67-44bb-49ab-8aed-5dcd78d828fc]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:14:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:20 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 Sep 03 20:14:20 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:20 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3" returned: 0 in 0.590s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:20 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 Sep 03 20:14:20 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:21 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391" returned: 0 in 0.437s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:21 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391 Sep 03 20:14:21 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:21 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3.a5fdfb5c-9814-4016-8d58-18ed7fa6a391" returned: 0 in 0.326s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "cinder-quobyte-a5fdfb5c-9814-4016-8d58-18ed7fa6a391" released by "_delete_snapshot" :: held 1.959s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:14:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "cinder-quobyte-04ee6886-ed43-4d0d-9db8-c301803a49f3" released by "delete_snapshot" :: held 2.007s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:14:21 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Created reservations ['03fc2eb5-200d-4d15-a8c1-34a37f87daa3', '7e8521fd-c891-4e9c-ad12-c29cc1bd1939', 'dd0b0328-1d46-441c-8af9-7df02693dfd8', 'd631079c-f78b-48f8-9478-ca35a0bad84d'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:14:21 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Delete snapshot completed successfully. Sep 03 20:14:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bfcfb866-ca1b-4b53-a5f1-5af362cc044c tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "cinder-a5fdfb5c-9814-4016-8d58-18ed7fa6a391-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:14:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Acquiring lock "cinder-04ee6886-ed43-4d0d-9db8-c301803a49f3-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:14:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "cinder-04ee6886-ed43-4d0d-9db8-c301803a49f3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:14:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Acquiring lock "cinder-quobyte-04ee6886-ed43-4d0d-9db8-c301803a49f3" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:14:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "cinder-quobyte-04ee6886-ed43-4d0d-9db8-c301803a49f3" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:14:22 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dc5797-0051-49e4-b22d-287e198b04a8]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:14:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:22 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 Sep 03 20:14:22 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:22 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3" returned: 0 in 0.480s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:22 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3 Sep 03 20:14:22 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:23 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04ee6886-ed43-4d0d-9db8-c301803a49f3" returned: 0 in 0.428s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "cinder-quobyte-04ee6886-ed43-4d0d-9db8-c301803a49f3" released by "delete_volume" :: held 1.033s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:14:23 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Created reservations ['9ed654c5-9030-4564-a2fc-7434d474d87e', '7107d0ec-c6d0-4b5f-be90-7e6de8375d32', '04cecbd1-16f8-457d-bfc5-2a880cd123ce', 'f2078342-5a86-4c66-a2b3-db28ec90bb28'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:14:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:14:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:14:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:23 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:14:23 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:23 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.324s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:23 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:14:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Deleted volume successfully. Sep 03 20:14:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9d901438-c641-4f50-8ce0-9ad3e4f84850 tempest-VolumesSnapshotNegativeTestJSON-73433721 None] Lock "cinder-04ee6886-ed43-4d0d-9db8-c301803a49f3-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:14:33 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=18,cinder:UPDATE=16,cinder:INSERT=6 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:14:33 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=19,cinder:DELETE=3 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:14:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:14:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:14:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:14:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:36 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:14:36 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:37 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.269s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:14:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:14:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 28 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:14:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:14:45 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-eee80c2e-3bb7-4001-9c70-9d43e9a781c2 tempest-TestShelveInstance-2106554556 None] Terminate volume connection completed successfully. Sep 03 20:14:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-eee80c2e-3bb7-4001-9c70-9d43e9a781c2 tempest-TestShelveInstance-2106554556 None] Deleting attachment 8f0040b1-98fc-40c4-a565-7cc256530efb. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:14:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Acquiring lock "cinder-04098dac-14f1-4ea9-b679-070b74c3b107-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:14:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Lock "cinder-04098dac-14f1-4ea9-b679-070b74c3b107-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:14:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Acquiring lock "cinder-quobyte-04098dac-14f1-4ea9-b679-070b74c3b107" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:14:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Lock "cinder-quobyte-04098dac-14f1-4ea9-b679-070b74c3b107" acquired by "delete_volume" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:14:46 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe31d9-7b6b-43e8-a3ed-a7ce998476ea]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:14:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:46 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 Sep 03 20:14:46 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:46 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107" returned: 0 in 0.761s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:46 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107 Sep 03 20:14:46 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:47 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04098dac-14f1-4ea9-b679-070b74c3b107" returned: 0 in 0.405s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Lock "cinder-quobyte-04098dac-14f1-4ea9-b679-070b74c3b107" released by "delete_volume" :: held 1.245s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:14:47 devstack cinder-volume[87582]: DEBUG cinder.quota [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Created reservations ['e7e2cdc4-022f-405c-b549-3ebedcc54d38', 'ea6ceb78-0a8b-4c8e-9650-acfb26e2f44d', 'ab3542f0-5d68-4fd9-ac3d-4030414eba0e', '7d31d6ba-690b-4ee6-8590-1eb1606906d8'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:14:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:14:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:14:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:47 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:14:47 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:48 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.617s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:48 devstack cinder-volume[87582]: DEBUG cinder.manager [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:14:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Deleted volume successfully. Sep 03 20:14:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [req-ffb71e33-9f7e-476d-9d8e-4c1fd2f8a659 req-1debbd30-e5a2-4b35-a8bd-4d1cc2a78c87 tempest-TestShelveInstance-2106554556 None] Lock "cinder-04098dac-14f1-4ea9-b679-070b74c3b107-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Flow 'volume_create_manager' (fc99ee0d-d9d4-4a30-8374-6d60ad090bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811b6e40-581c-4c3d-b40f-c1f8f4ce5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811b6e40-581c-4c3d-b40f-c1f8f4ce5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-72167468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f723398-5d28-4db4-8eaa-7a56f358a990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3befc9d7234e2e94cf452bbd04c5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:14:50Z,use_quota=True,user_id='96d54dc34ab149b090ddb9e0f6b5652e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebeffa99-7fe0-4291-a82f-989d2455c129),volume_type_id=ebeffa99-7fe0-4291-a82f-989d2455c129)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ce90e2-324e-4a06-a92d-4a563c214fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ce90e2-324e-4a06-a92d-4a563c214fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27941a58-9494-43a6-982f-6683c6a5fda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27941a58-9494-43a6-982f-6683c6a5fda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f723398-5d28-4db4-8eaa-7a56f358a990', 'volume_name': 'volume-7f723398-5d28-4db4-8eaa-7a56f358a990', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2306dbd4-9dc7-4925-a4fe-90b1ec5f0d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2306dbd4-9dc7-4925-a4fe-90b1ec5f0d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9280a196-74a5-4820-a3ba-b6c5e06d4529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:50 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Volume 7f723398-5d28-4db4-8eaa-7a56f358a990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f723398-5d28-4db4-8eaa-7a56f358a990', 'volume_size': 1} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-72167468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f723398-5d28-4db4-8eaa-7a56f358a990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3befc9d7234e2e94cf452bbd04c5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:14:50Z,use_quota=True,user_id='96d54dc34ab149b090ddb9e0f6b5652e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebeffa99-7fe0-4291-a82f-989d2455c129),volume_type_id=ebeffa99-7fe0-4291-a82f-989d2455c129)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Creating volume 7f723398-5d28-4db4-8eaa-7a56f358a990 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:14:50 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:14:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7f723398-5d28-4db4-8eaa-7a56f358a990 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:50 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7f723398-5d28-4db4-8eaa-7a56f358a990 1073741824 Sep 03 20:14:50 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Flow 'volume_create_manager' (533267f6-3302-43be-9a41-55b5542c73de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4fa69b-cef7-4317-88a4-42f974ff7596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4fa69b-cef7-4317-88a4-42f974ff7596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1548450758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba4b70c-2ada-4ba5-be7f-99607152bb0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3befc9d7234e2e94cf452bbd04c5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:14:51Z,use_quota=True,user_id='96d54dc34ab149b090ddb9e0f6b5652e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ab569c2-37ce-4c93-9547-3ad888ed7e50),volume_type_id=5ab569c2-37ce-4c93-9547-3ad888ed7e50)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61704c3e-c538-49ca-84bb-4214fb326738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61704c3e-c538-49ca-84bb-4214fb326738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb26ccd-ccbe-453b-bfc7-c7d97cb58830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb26ccd-ccbe-453b-bfc7-c7d97cb58830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dba4b70c-2ada-4ba5-be7f-99607152bb0d', 'volume_name': 'volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a65f88-9da4-4baa-a0ad-8ac0afa67edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a65f88-9da4-4baa-a0ad-8ac0afa67edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8501beb0-818a-401b-ab82-ae72cfd90e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:51 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Volume dba4b70c-2ada-4ba5-be7f-99607152bb0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d', 'volume_size': 1} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:51 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7f723398-5d28-4db4-8eaa-7a56f358a990 1073741824" returned: 0 in 0.983s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7f723398-5d28-4db4-8eaa-7a56f358a990 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:51 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7f723398-5d28-4db4-8eaa-7a56f358a990 Sep 03 20:14:51 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-5bd0565c-ea0c-4fe3-8f90-76b924203548 req-2cdad12a-cfaf-494b-a3ab-46903ea10c0e tempest-TestStampPattern-813740280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:51 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7f723398-5d28-4db4-8eaa-7a56f358a990" returned: 0 in 0.477s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1548450758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba4b70c-2ada-4ba5-be7f-99607152bb0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3befc9d7234e2e94cf452bbd04c5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:14:51Z,use_quota=True,user_id='96d54dc34ab149b090ddb9e0f6b5652e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ab569c2-37ce-4c93-9547-3ad888ed7e50),volume_type_id=5ab569c2-37ce-4c93-9547-3ad888ed7e50)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Creating volume dba4b70c-2ada-4ba5-be7f-99607152bb0d {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:14:51 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9280a196-74a5-4820-a3ba-b6c5e06d4529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f723398-5d28-4db4-8eaa-7a56f358a990', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:51 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d 1073741824 Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e208df1-2fa8-4ff4-bd49-f433e2bff4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:51 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Flow 'volume_create_manager' (819f3718-26e6-4681-acd5-844714b8a5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:14:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9db9c0-651c-45a2-8082-a49d89a0b2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9db9c0-651c-45a2-8082-a49d89a0b2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1126097892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8694ad4-595e-4ae5-9f6d-88b978a738e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3befc9d7234e2e94cf452bbd04c5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:14:52Z,use_quota=True,user_id='96d54dc34ab149b090ddb9e0f6b5652e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcc64636-ceb0-4bfe-b84f-28c13121afc7),volume_type_id=fcc64636-ceb0-4bfe-b84f-28c13121afc7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251b910c-be29-4aa9-aeae-e5a3953e976f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251b910c-be29-4aa9-aeae-e5a3953e976f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba10f549-32e9-4e03-885f-6a9ddfe477b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG cinder.image.glance [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Creating Keystone auth plugin from conf {{(pid=87582) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 20:14:52 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Volume volume-7f723398-5d28-4db4-8eaa-7a56f358a990 (7f723398-5d28-4db4-8eaa-7a56f358a990): created successfully Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e208df1-2fa8-4ff4-bd49-f433e2bff4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Flow 'volume_create_manager' (fc99ee0d-d9d4-4a30-8374-6d60ad090bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:14:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-aa9e179c-eb8b-4dd2-8a5d-97d5c021f2ae tempest-TestInstancesWithCinderVolumes-343188725 None] Created volume successfully. Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba10f549-32e9-4e03-885f-6a9ddfe477b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd8694ad4-595e-4ae5-9f6d-88b978a738e7', 'volume_name': 'volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7', 'volume_size': 1, 'image_id': '3a111507-b264-4f15-9ebb-36c4f5f13cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a111507-b264-4f15-9ebb-36c4f5f13cfa', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--710363745', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d3befc9d7234e2e94cf452bbd04c5f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a111507-b264-4f15-9ebb-36c4f5f13cfa', 'created_at': datetime.datetime(2026, 9, 3, 18, 14, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 14, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a111507-b264-4f15-9ebb-36c4f5f13cfa/file', 'properties': {}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40360540-39d9-4a50-90fd-1032ef3a6176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40360540-39d9-4a50-90fd-1032ef3a6176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fa9ead-9bd2-426f-8c58-2631cdea33c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:52 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Volume d8694ad4-595e-4ae5-9f6d-88b978a738e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7', 'volume_size': 1, 'image_id': '3a111507-b264-4f15-9ebb-36c4f5f13cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a111507-b264-4f15-9ebb-36c4f5f13cfa', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--710363745', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d3befc9d7234e2e94cf452bbd04c5f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a111507-b264-4f15-9ebb-36c4f5f13cfa', 'created_at': datetime.datetime(2026, 9, 3, 18, 14, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 14, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a111507-b264-4f15-9ebb-36c4f5f13cfa/file', 'properties': {}}, 'image_service': } Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Trying to clone d8694ad4-595e-4ae5-9f6d-88b978a738e7 from image 3a111507-b264-4f15-9ebb-36c4f5f13cfa at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a111507-b264-4f15-9ebb-36c4f5f13cfa', 'metadata': {}}]). {{(pid=87582) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 20:14:52 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d 1073741824" returned: 0 in 0.702s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:52 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d Sep 03 20:14:52 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:53 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d" returned: 0 in 0.362s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:14:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-5bd0565c-ea0c-4fe3-8f90-76b924203548 req-2cdad12a-cfaf-494b-a3ab-46903ea10c0e tempest-TestStampPattern-813740280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.267s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:53 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8501beb0-818a-401b-ab82-ae72cfd90e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:53 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511e39b5-fe2c-480b-857e-caf48fb28974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-5bd0565c-ea0c-4fe3-8f90-76b924203548 req-2cdad12a-cfaf-494b-a3ab-46903ea10c0e tempest-TestStampPattern-813740280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:53 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Volume volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d (dba4b70c-2ada-4ba5-be7f-99607152bb0d): created successfully Sep 03 20:14:53 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511e39b5-fe2c-480b-857e-caf48fb28974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:53 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Flow 'volume_create_manager' (533267f6-3302-43be-9a41-55b5542c73de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:14:53 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-418ad99a-d74f-45a3-bb05-c05810184b88 tempest-TestInstancesWithCinderVolumes-343188725 None] Created volume successfully. Sep 03 20:14:53 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-5bd0565c-ea0c-4fe3-8f90-76b924203548 req-2cdad12a-cfaf-494b-a3ab-46903ea10c0e tempest-TestStampPattern-813740280 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-612afe83-f985-4e2c-8d7b-63f520194154', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7dcc3b2f-ff06-4e54-b892-5dc38efcb72e', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:14:53 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-5bd0565c-ea0c-4fe3-8f90-76b924203548 req-2cdad12a-cfaf-494b-a3ab-46903ea10c0e tempest-TestStampPattern-813740280 None] attachment_update completed successfully. Sep 03 20:14:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-5810365c-8825-4d77-8769-c56e196e346b req-77f67615-233d-42b7-ab27-60c1908c1f2c tempest-TestStampPattern-813740280 None] Terminate volume connection completed successfully. Sep 03 20:14:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-5810365c-8825-4d77-8769-c56e196e346b req-77f67615-233d-42b7-ab27-60c1908c1f2c tempest-TestStampPattern-813740280 None] Deleting attachment 7dcc3b2f-ff06-4e54-b892-5dc38efcb72e. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:14:57 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD, size 20.69 MB, duration 5.00 sec {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 20:14:57 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Image download 20.69 MB at 4.13 MB/s Sep 03 20:14:57 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b058c3c3-490c-4137-b17f-bbc61e197658]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:14:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:57 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD Sep 03 20:14:57 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:57 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:57 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Temporary image 3a111507-b264-4f15-9ebb-36c4f5f13cfa is fetched for user 96d54dc34ab149b090ddb9e0f6b5652e. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 20:14:57 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef2c53d-355a-42ce-9d87-602ff3b0b559]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:14:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:58 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD Sep 03 20:14:58 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:58 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1126097892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8694ad4-595e-4ae5-9f6d-88b978a738e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3befc9d7234e2e94cf452bbd04c5f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:14:52Z,use_quota=True,user_id='96d54dc34ab149b090ddb9e0f6b5652e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcc64636-ceb0-4bfe-b84f-28c13121afc7),volume_type_id=fcc64636-ceb0-4bfe-b84f-28c13121afc7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:14:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Creating volume d8694ad4-595e-4ae5-9f6d-88b978a738e7 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:14:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:14:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:14:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:14:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:14:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:14:58 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:14:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:58 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 1073741824 Sep 03 20:14:58 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:59 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 1073741824" returned: 0 in 0.757s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Flow 'volume_create_manager' (fad67c7c-dde1-4d20-88ff-0b83e6e89665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff71e3c-d12b-42f9-b951-5b037ac2f480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff71e3c-d12b-42f9-b951-5b037ac2f480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1092522700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db1d39a-58d0-4b92-b9c0-b0c32e648b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438e2d509735475f8a4b0abe0ede53ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:14:59Z,use_quota=True,user_id='e09c69ca270e4b76bbe00559a07506a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46a6354-e587-46c0-9e69-76c90fabfd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46a6354-e587-46c0-9e69-76c90fabfd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1dd2ff-e9b4-4530-8229-6150e14fd5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1dd2ff-e9b4-4530-8229-6150e14fd5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db1d39a-58d0-4b92-b9c0-b0c32e648b91', 'volume_name': 'volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7bd519-7755-449a-9b2d-ff49e51f09ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7bd519-7755-449a-9b2d-ff49e51f09ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d8e09c-61db-48a7-9491-68ed82ccf899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:59 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Volume 4db1d39a-58d0-4b92-b9c0-b0c32e648b91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91', 'volume_size': 1} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:14:59 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 Sep 03 20:14:59 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Flow 'volume_create_manager' (8e25927b-3f8a-467f-bd87-353c55f1dbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2104c379-a7b4-419c-ae5b-4f9de0dd72e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2104c379-a7b4-419c-ae5b-4f9de0dd72e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-932691659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f4af9e-8fce-45c7-9620-fe131261a43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438e2d509735475f8a4b0abe0ede53ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:00Z,use_quota=True,user_id='e09c69ca270e4b76bbe00559a07506a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384f6165-1949-45f0-a01d-0d5891cd966a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384f6165-1949-45f0-a01d-0d5891cd966a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df8e44b-3b04-4572-9c05-07ae5598b9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df8e44b-3b04-4572-9c05-07ae5598b9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f4af9e-8fce-45c7-9620-fe131261a43a', 'volume_name': 'volume-b3f4af9e-8fce-45c7-9620-fe131261a43a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89044e95-6ff3-4f72-947f-701171a2c303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89044e95-6ff3-4f72-947f-701171a2c303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9bc1027-0da9-4626-9b27-c9bc5bac2fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:14:59 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Volume b3f4af9e-8fce-45c7-9620-fe131261a43a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f4af9e-8fce-45c7-9620-fe131261a43a', 'volume_size': 1} Sep 03 20:14:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:14:59 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7" returned: 0 in 0.685s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.714s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1092522700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db1d39a-58d0-4b92-b9c0-b0c32e648b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438e2d509735475f8a4b0abe0ede53ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:14:59Z,use_quota=True,user_id='e09c69ca270e4b76bbe00559a07506a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Creating volume 4db1d39a-58d0-4b92-b9c0-b0c32e648b91 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:00 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:00 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91 1073741824 Sep 03 20:15:00 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Attempting download of 3a111507-b264-4f15-9ebb-36c4f5f13cfa ((None, [{'url': 'file:///opt/stack/data/glance/images/3a111507-b264-4f15-9ebb-36c4f5f13cfa', 'metadata': {}}])) to volume d8694ad4-595e-4ae5-9f6d-88b978a738e7. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9071206-6972-484c-a633-0485420e27d0]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a111507-b264-4f15-9ebb-36c4f5f13cfa_oebxxjc8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:00 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a111507-b264-4f15-9ebb-36c4f5f13cfa_oebxxjc8 Sep 03 20:15:00 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:00 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a111507-b264-4f15-9ebb-36c4f5f13cfa_oebxxjc8" returned: 0 in 0.399s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a111507-b264-4f15-9ebb-36c4f5f13cfa_oebxxjc8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:00 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91 1073741824" returned: 0 in 0.653s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:00 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a111507-b264-4f15-9ebb-36c4f5f13cfa_oebxxjc8 Sep 03 20:15:00 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:00 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91 Sep 03 20:15:00 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:01 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a111507-b264-4f15-9ebb-36c4f5f13cfa_oebxxjc8" returned: 1 in 0.496s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a111507-b264-4f15-9ebb-36c4f5f13cfa_oebxxjc8' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7645019-74a1-4c76-aff7-e90a2b127cf2]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:01 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91" returned: 0 in 0.368s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.142s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-932691659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f4af9e-8fce-45c7-9620-fe131261a43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438e2d509735475f8a4b0abe0ede53ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:00Z,use_quota=True,user_id='e09c69ca270e4b76bbe00559a07506a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Creating volume b3f4af9e-8fce-45c7-9620-fe131261a43a {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:01 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3f4af9e-8fce-45c7-9620-fe131261a43a 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:01 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3f4af9e-8fce-45c7-9620-fe131261a43a 1073741824 Sep 03 20:15:01 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d8e09c-61db-48a7-9491-68ed82ccf899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8d4018-475f-49d7-b5ad-0a1edd21d0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:01 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD Sep 03 20:15:01 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:01 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Volume volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91 (4db1d39a-58d0-4b92-b9c0-b0c32e648b91): created successfully Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8d4018-475f-49d7-b5ad-0a1edd21d0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Flow 'volume_create_manager' (fad67c7c-dde1-4d20-88ff-0b83e6e89665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:01 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-96d578f8-5f25-4d0e-8801-02809ebeb8ed tempest-TestServerVolumeAttachmentScenario-1760028514 None] Created volume successfully. Sep 03 20:15:01 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] 3a111507-b264-4f15-9ebb-36c4f5f13cfa was qcow2, converting to qcow2 {{(pid=87582) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:01 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 Sep 03 20:15:01 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:01 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3f4af9e-8fce-45c7-9620-fe131261a43a 1073741824" returned: 0 in 0.751s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3f4af9e-8fce-45c7-9620-fe131261a43a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:01 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3f4af9e-8fce-45c7-9620-fe131261a43a Sep 03 20:15:01 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:02 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3f4af9e-8fce-45c7-9620-fe131261a43a" returned: 0 in 0.364s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9bc1027-0da9-4626-9b27-c9bc5bac2fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f4af9e-8fce-45c7-9620-fe131261a43a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494cbef6-d25c-4335-92da-822deb710243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:02 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Volume volume-b3f4af9e-8fce-45c7-9620-fe131261a43a (b3f4af9e-8fce-45c7-9620-fe131261a43a): created successfully Sep 03 20:15:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494cbef6-d25c-4335-92da-822deb710243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Flow 'volume_create_manager' (8e25927b-3f8a-467f-bd87-353c55f1dbd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:02 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-bf800c53-54b7-4923-b6c9-6b74f47035ad tempest-TestServerVolumeAttachmentScenario-1760028514 None] Created volume successfully. Sep 03 20:15:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Acquiring lock "cinder-612afe83-f985-4e2c-8d7b-63f520194154-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Lock "cinder-612afe83-f985-4e2c-8d7b-63f520194154-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Acquiring lock "cinder-quobyte-612afe83-f985-4e2c-8d7b-63f520194154" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Lock "cinder-quobyte-612afe83-f985-4e2c-8d7b-63f520194154" acquired by "delete_volume" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:03 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[501d487d-e7e0-4f95-a351-dca4d84820f2]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:03 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154 Sep 03 20:15:03 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:04 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7" returned: 0 in 2.636s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a111507-b264-4f15-9ebb-36c4f5f13cfa_041sn2msdevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:15:04 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Converted 112.00 MB image at 42.44 MB/s Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:04 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 1G Sep 03 20:15:04 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:04 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154" returned: 0 in 0.459s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:04 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154 Sep 03 20:15:04 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:04 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-612afe83-f985-4e2c-8d7b-63f520194154" returned: 0 in 0.320s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:04 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 1G" returned: 0 in 0.381s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Downloaded image 3a111507-b264-4f15-9ebb-36c4f5f13cfa ((None, [{'url': 'file:///opt/stack/data/glance/images/3a111507-b264-4f15-9ebb-36c4f5f13cfa', 'metadata': {}}])) to volume d8694ad4-595e-4ae5-9f6d-88b978a738e7 successfully. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Temporary image 3a111507-b264-4f15-9ebb-36c4f5f13cfa for user 96d54dc34ab149b090ddb9e0f6b5652e is deleted. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Marking volume d8694ad4-595e-4ae5-9f6d-88b978a738e7 as bootable. {{(pid=87582) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Lock "cinder-quobyte-612afe83-f985-4e2c-8d7b-63f520194154" released by "delete_volume" :: held 0.862s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Copying metadata from image 3a111507-b264-4f15-9ebb-36c4f5f13cfa to d8694ad4-595e-4ae5-9f6d-88b978a738e7. {{(pid=87582) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Creating volume glance metadata for volume d8694ad4-595e-4ae5-9f6d-88b978a738e7 backed by image 3a111507-b264-4f15-9ebb-36c4f5f13cfa with: {'image_id': '3a111507-b264-4f15-9ebb-36c4f5f13cfa', 'image_name': 'tempest-scenario-img--710363745', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87582) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Created reservations ['6284ddf2-a488-4573-86f2-27047eeffbbc', '00937a2d-5e43-46a8-a5b2-ed65aceaeb38', 'b1197e6d-7b66-4f6f-87d4-574da8f45b17', '834b678c-8823-4d59-bcba-9642631b8306'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fa9ead-9bd2-426f-8c58-2631cdea33c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7', 'volume_size': 1, 'image_id': '3a111507-b264-4f15-9ebb-36c4f5f13cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a111507-b264-4f15-9ebb-36c4f5f13cfa', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--710363745', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d3befc9d7234e2e94cf452bbd04c5f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a111507-b264-4f15-9ebb-36c4f5f13cfa', 'created_at': datetime.datetime(2026, 9, 3, 18, 14, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 14, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a111507-b264-4f15-9ebb-36c4f5f13cfa/file', 'properties': {}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76adb158-c94c-4b9b-9bcb-fc3db79eec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:04 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Volume volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 (d8694ad4-595e-4ae5-9f6d-88b978a738e7): created successfully Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76adb158-c94c-4b9b-9bcb-fc3db79eec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Flow 'volume_create_manager' (819f3718-26e6-4681-acd5-844714b8a5a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:04 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-3b055702-ee7d-4439-941a-8ae7abd32ddb tempest-TestInstancesWithCinderVolumes-343188725 None] Created volume successfully. Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:04 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:04 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Acquiring lock "cinder-b89ea654-75c7-47ed-8718-a5b4913f143a-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Lock "cinder-b89ea654-75c7-47ed-8718-a5b4913f143a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Acquiring lock "cinder-quobyte-8957f262-1c50-49c5-83e2-44d02c2ed7a2" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Lock "cinder-quobyte-8957f262-1c50-49c5-83e2-44d02c2ed7a2" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Acquiring lock "cinder-quobyte-b89ea654-75c7-47ed-8718-a5b4913f143a" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:05 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.568s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:05 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:05 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Deleted volume successfully. Sep 03 20:15:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Lock "cinder-quobyte-b89ea654-75c7-47ed-8718-a5b4913f143a" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Deleting offline snapshot b89ea654-75c7-47ed-8718-a5b4913f143a of volume 8957f262-1c50-49c5-83e2-44d02c2ed7a2 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:15:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] snapshot_file for this snap is: volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:15:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2652c6bd-f7d8-4c47-84fa-3a5a522375bb tempest-TestStampPattern-813740280 None] Lock "cinder-612afe83-f985-4e2c-8d7b-63f520194154-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:05 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dad02f1-613d-4743-b09a-f4670276ddf0]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:05 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a Sep 03 20:15:05 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:05 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a" returned: 0 in 0.507s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:15:06 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eaec4b-7ec0-4a8f-8385-2d375e99023d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:06 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 Sep 03 20:15:06 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:06 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2" returned: 0 in 0.952s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:07 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a Sep 03 20:15:07 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:07 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a" returned: 0 in 0.624s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:07 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a Sep 03 20:15:07 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:08 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2.b89ea654-75c7-47ed-8718-a5b4913f143a" returned: 0 in 0.449s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Lock "cinder-quobyte-b89ea654-75c7-47ed-8718-a5b4913f143a" released by "_delete_snapshot" :: held 2.691s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Lock "cinder-quobyte-8957f262-1c50-49c5-83e2-44d02c2ed7a2" released by "delete_snapshot" :: held 2.743s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:08 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Created reservations ['85007998-c03b-4f12-be57-4fcf02966330', '4fd99c31-325c-4d49-9dd8-2f5f78e929f6', 'ef6da56c-9966-4818-ab8e-0be40bf045c7', '3dfa5343-1d75-484f-b24c-1a637e8e7471'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Delete snapshot completed successfully. Sep 03 20:15:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c123f36a-efdd-4616-9906-b1219aa2d40a tempest-TestStampPattern-813740280 None] Lock "cinder-b89ea654-75c7-47ed-8718-a5b4913f143a-delete_snapshot" released by "delete_snapshot" :: held 2.968s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-a40d54f7-dfc2-4540-92a9-719a678d2a51 req-9026681e-39ae-419d-942c-79f745db3ed6 tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-a40d54f7-dfc2-4540-92a9-719a678d2a51 req-9026681e-39ae-419d-942c-79f745db3ed6 tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-a40d54f7-dfc2-4540-92a9-719a678d2a51 req-9026681e-39ae-419d-942c-79f745db3ed6 tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-a40d54f7-dfc2-4540-92a9-719a678d2a51 req-9026681e-39ae-419d-942c-79f745db3ed6 tempest-TestInstancesWithCinderVolumes-343188725 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc87a53d-b7fe-4733-a2b8-a3dbfd49b129', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:15:09 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-a40d54f7-dfc2-4540-92a9-719a678d2a51 req-9026681e-39ae-419d-942c-79f745db3ed6 tempest-TestInstancesWithCinderVolumes-343188725 None] attachment_update completed successfully. Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Flow 'volume_create_manager' (fbd3cf46-347a-4211-8efe-917ab9d4fd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cc23d7-115f-4813-b55a-8e1496447f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cc23d7-115f-4813-b55a-8e1496447f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2086362760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3796f819-86cc-4caa-9acf-c20f865af029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cbab0ca34a408a9799f941adefa62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:10Z,use_quota=True,user_id='74e0f4a9278046e0b25e178b37dc2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e7b1b3-f5b2-48c9-84b6-ad954a89894c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e7b1b3-f5b2-48c9-84b6-ad954a89894c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6d09df-ac6d-4872-9b99-386b6d568566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6d09df-ac6d-4872-9b99-386b6d568566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3796f819-86cc-4caa-9acf-c20f865af029', 'volume_name': 'volume-3796f819-86cc-4caa-9acf-c20f865af029', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540d8d35-f9df-4616-95c7-cd0badddb71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540d8d35-f9df-4616-95c7-cd0badddb71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2cd0007-8560-4ef6-8e2f-1fbff4f68dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:10 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Volume 3796f819-86cc-4caa-9acf-c20f865af029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3796f819-86cc-4caa-9acf-c20f865af029', 'volume_size': 1} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2086362760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3796f819-86cc-4caa-9acf-c20f865af029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cbab0ca34a408a9799f941adefa62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:10Z,use_quota=True,user_id='74e0f4a9278046e0b25e178b37dc2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Creating volume 3796f819-86cc-4caa-9acf-c20f865af029 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:10 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3796f819-86cc-4caa-9acf-c20f865af029 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:10 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3796f819-86cc-4caa-9acf-c20f865af029 1073741824 Sep 03 20:15:10 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Flow 'volume_create_manager' (516d60af-a03c-415f-9a7f-a957d0fa9c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec5c204-b006-440c-b8cb-95148410e37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec5c204-b006-440c-b8cb-95148410e37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233109550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85a747b-6ab0-43e7-b2db-1ddb460dd137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cbab0ca34a408a9799f941adefa62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:11Z,use_quota=True,user_id='74e0f4a9278046e0b25e178b37dc2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2fee28-bdea-4db1-a93b-2820b95ceb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2fee28-bdea-4db1-a93b-2820b95ceb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684cab70-9ee5-4719-8c20-d2da4725fbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684cab70-9ee5-4719-8c20-d2da4725fbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85a747b-6ab0-43e7-b2db-1ddb460dd137', 'volume_name': 'volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708f371b-f32d-44ba-bfe8-e2832031cb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708f371b-f32d-44ba-bfe8-e2832031cb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca9ab46-f8f8-4da0-ae9b-dcc8dca8421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:10 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Volume b85a747b-6ab0-43e7-b2db-1ddb460dd137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137', 'volume_size': 1} Sep 03 20:15:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:11 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3796f819-86cc-4caa-9acf-c20f865af029 1073741824" returned: 0 in 0.683s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3796f819-86cc-4caa-9acf-c20f865af029 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:11 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3796f819-86cc-4caa-9acf-c20f865af029 Sep 03 20:15:11 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Flow 'volume_create_manager' (54c97c1c-4552-4777-a7b9-8e2d664bfc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130d411e-caef-4e04-b143-0faa39c5f01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130d411e-caef-4e04-b143-0faa39c5f01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1366479492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ef6e4b-f5b8-4da4-a911-9172034df1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cbab0ca34a408a9799f941adefa62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:11Z,use_quota=True,user_id='74e0f4a9278046e0b25e178b37dc2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c4f232-d3dd-439c-bb06-cebbb4d57634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c4f232-d3dd-439c-bb06-cebbb4d57634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7dda80-eea0-4b62-9164-d876991758c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7dda80-eea0-4b62-9164-d876991758c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ef6e4b-f5b8-4da4-a911-9172034df1b8', 'volume_name': 'volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6b8487-37ec-4ec5-aa57-9322ac0bb77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6b8487-37ec-4ec5-aa57-9322ac0bb77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:11 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b510dd-95ed-41fd-8a9e-6496fb3cd211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:11 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Volume c0ef6e4b-f5b8-4da4-a911-9172034df1b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8', 'volume_size': 1} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3796f819-86cc-4caa-9acf-c20f865af029" returned: 0 in 0.600s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233109550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85a747b-6ab0-43e7-b2db-1ddb460dd137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cbab0ca34a408a9799f941adefa62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:11Z,use_quota=True,user_id='74e0f4a9278046e0b25e178b37dc2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Creating volume b85a747b-6ab0-43e7-b2db-1ddb460dd137 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:11 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:11 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137 1073741824 Sep 03 20:15:11 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2cd0007-8560-4ef6-8e2f-1fbff4f68dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3796f819-86cc-4caa-9acf-c20f865af029', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d87fbfe-01fb-431c-8885-35ed438d85e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:11 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Volume volume-3796f819-86cc-4caa-9acf-c20f865af029 (3796f819-86cc-4caa-9acf-c20f865af029): created successfully Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d87fbfe-01fb-431c-8885-35ed438d85e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Flow 'volume_create_manager' (fbd3cf46-347a-4211-8efe-917ab9d4fd96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:11 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f3c7ec0c-31d9-42ea-afab-526b4f2420d9 tempest-CreateVolumesFromImageTest-1515620649 None] Created volume successfully. Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Flow 'volume_create_manager' (bef5107f-0e58-4471-90b1-259607fb1dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166c841f-14c7-47b6-b8ee-da5ffe8fe9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166c841f-14c7-47b6-b8ee-da5ffe8fe9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-845947905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3727c977-ac51-4bda-867d-19a4b5fffe3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cbab0ca34a408a9799f941adefa62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:12Z,use_quota=True,user_id='74e0f4a9278046e0b25e178b37dc2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0276ce-b03e-4bf1-963f-caed60f2b1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0276ce-b03e-4bf1-963f-caed60f2b1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ad31b3-f3c7-46ba-8442-fcf7916eb4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ad31b3-f3c7-46ba-8442-fcf7916eb4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3727c977-ac51-4bda-867d-19a4b5fffe3c', 'volume_name': 'volume-3727c977-ac51-4bda-867d-19a4b5fffe3c', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b965568f-d833-437e-a212-a9fb981da38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:12 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b965568f-d833-437e-a212-a9fb981da38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81808a39-0496-4ce8-82d4-229e08c312dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:12 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Volume 3727c977-ac51-4bda-867d-19a4b5fffe3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3727c977-ac51-4bda-867d-19a4b5fffe3c', 'volume_size': 1} Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137 1073741824" returned: 0 in 0.873s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:12 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137 Sep 03 20:15:12 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Flow 'volume_create_manager' (9180fdb5-4bf1-471a-8f77-9440de80ed14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e831c501-4f8f-4e46-8104-105df9a2ab27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:13 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e831c501-4f8f-4e46-8104-105df9a2ab27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-825426677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93821fad-29c5-4135-9107-6bb6899aa2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cbab0ca34a408a9799f941adefa62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:13Z,use_quota=True,user_id='74e0f4a9278046e0b25e178b37dc2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6efe815-046f-4154-8396-a49aaa008986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6efe815-046f-4154-8396-a49aaa008986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88ddc05-9734-483e-9c38-5604b3c4bf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88ddc05-9734-483e-9c38-5604b3c4bf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93821fad-29c5-4135-9107-6bb6899aa2c0', 'volume_name': 'volume-93821fad-29c5-4135-9107-6bb6899aa2c0', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6703aa49-5dbf-4cb7-a1a7-60d2e40c87f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6703aa49-5dbf-4cb7-a1a7-60d2e40c87f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2bdb74-2c7d-4572-8055-ecf33e4672ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:13 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Volume 93821fad-29c5-4135-9107-6bb6899aa2c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93821fad-29c5-4135-9107-6bb6899aa2c0', 'volume_size': 1} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137" returned: 0 in 0.487s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.479s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1366479492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ef6e4b-f5b8-4da4-a911-9172034df1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cbab0ca34a408a9799f941adefa62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:11Z,use_quota=True,user_id='74e0f4a9278046e0b25e178b37dc2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Creating volume c0ef6e4b-f5b8-4da4-a911-9172034df1b8 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:13 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca9ab46-f8f8-4da0-ae9b-dcc8dca8421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:13 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8 1073741824 Sep 03 20:15:13 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a952a8-5c20-4cb3-a1fa-c15a710e035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:13 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Volume volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137 (b85a747b-6ab0-43e7-b2db-1ddb460dd137): created successfully Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a952a8-5c20-4cb3-a1fa-c15a710e035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Flow 'volume_create_manager' (516d60af-a03c-415f-9a7f-a957d0fa9c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:13 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-52022e50-2c84-4bef-8cea-4e73efca3ea8 tempest-CreateVolumesFromImageTest-1515620649 None] Created volume successfully. Sep 03 20:15:14 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8 1073741824" returned: 0 in 0.887s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:14 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8 Sep 03 20:15:14 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:14 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8" returned: 0 in 0.397s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.938s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-845947905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3727c977-ac51-4bda-867d-19a4b5fffe3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cbab0ca34a408a9799f941adefa62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:12Z,use_quota=True,user_id='74e0f4a9278046e0b25e178b37dc2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Creating volume 3727c977-ac51-4bda-867d-19a4b5fffe3c {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:14 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3727c977-ac51-4bda-867d-19a4b5fffe3c 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b510dd-95ed-41fd-8a9e-6496fb3cd211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:14 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3727c977-ac51-4bda-867d-19a4b5fffe3c 1073741824 Sep 03 20:15:14 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66facbcf-d584-40cb-9ad7-fa8ad645be60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:14 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Volume volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8 (c0ef6e4b-f5b8-4da4-a911-9172034df1b8): created successfully Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66facbcf-d584-40cb-9ad7-fa8ad645be60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Flow 'volume_create_manager' (54c97c1c-4552-4777-a7b9-8e2d664bfc34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:14 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a90fe46a-a859-48e0-a840-6ffbf4d6cec0 tempest-CreateVolumesFromImageTest-1515620649 None] Created volume successfully. Sep 03 20:15:15 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3727c977-ac51-4bda-867d-19a4b5fffe3c 1073741824" returned: 0 in 1.111s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3727c977-ac51-4bda-867d-19a4b5fffe3c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:15 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3727c977-ac51-4bda-867d-19a4b5fffe3c Sep 03 20:15:15 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:16 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3727c977-ac51-4bda-867d-19a4b5fffe3c" returned: 0 in 0.407s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.042s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-825426677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93821fad-29c5-4135-9107-6bb6899aa2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cbab0ca34a408a9799f941adefa62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:13Z,use_quota=True,user_id='74e0f4a9278046e0b25e178b37dc2c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Creating volume 93821fad-29c5-4135-9107-6bb6899aa2c0 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:16 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-93821fad-29c5-4135-9107-6bb6899aa2c0 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81808a39-0496-4ce8-82d4-229e08c312dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3727c977-ac51-4bda-867d-19a4b5fffe3c', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4891c379-b931-44a1-b25c-fed67998ee88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:16 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Volume volume-3727c977-ac51-4bda-867d-19a4b5fffe3c (3727c977-ac51-4bda-867d-19a4b5fffe3c): created successfully Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4891c379-b931-44a1-b25c-fed67998ee88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:16 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-93821fad-29c5-4135-9107-6bb6899aa2c0 1073741824 Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Flow 'volume_create_manager' (bef5107f-0e58-4471-90b1-259607fb1dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:16 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:16 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-4fbeb08e-15dc-44a2-a365-a92034e30272 tempest-CreateVolumesFromImageTest-1515620649 None] Created volume successfully. Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Acquiring lock "cinder-8957f262-1c50-49c5-83e2-44d02c2ed7a2-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Lock "cinder-8957f262-1c50-49c5-83e2-44d02c2ed7a2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Acquiring lock "cinder-quobyte-8957f262-1c50-49c5-83e2-44d02c2ed7a2" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Lock "cinder-quobyte-8957f262-1c50-49c5-83e2-44d02c2ed7a2" acquired by "delete_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:17 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[082c4919-f6cd-4305-98e0-8797ecfa6bec]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:17 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 Sep 03 20:15:17 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:17 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-93821fad-29c5-4135-9107-6bb6899aa2c0 1073741824" returned: 0 in 1.363s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-93821fad-29c5-4135-9107-6bb6899aa2c0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:17 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-93821fad-29c5-4135-9107-6bb6899aa2c0 Sep 03 20:15:17 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:18 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2" returned: 0 in 1.227s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:18 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2 Sep 03 20:15:18 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:18 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-93821fad-29c5-4135-9107-6bb6899aa2c0" returned: 0 in 0.666s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] <== create_volume: return (2309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.325s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2bdb74-2c7d-4572-8055-ecf33e4672ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93821fad-29c5-4135-9107-6bb6899aa2c0', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d897aa7c-9abc-45cd-9483-56779d0f1cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:18 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Volume volume-93821fad-29c5-4135-9107-6bb6899aa2c0 (93821fad-29c5-4135-9107-6bb6899aa2c0): created successfully Sep 03 20:15:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d897aa7c-9abc-45cd-9483-56779d0f1cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:18 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Flow 'volume_create_manager' (9180fdb5-4bf1-471a-8f77-9440de80ed14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:18 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d6c0f93d-842d-4edf-8c82-6e25b935c27b tempest-CreateVolumesFromImageTest-1515620649 None] Created volume successfully. Sep 03 20:15:18 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8957f262-1c50-49c5-83e2-44d02c2ed7a2" returned: 0 in 0.545s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Lock "cinder-quobyte-8957f262-1c50-49c5-83e2-44d02c2ed7a2" released by "delete_volume" :: held 1.929s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:19 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Created reservations ['fef6e2a3-0df0-4059-a25c-cfbd4c62ca4d', '64e15c67-f401-414d-b38d-231243768f63', 'bf0a94a3-1ba3-44c1-8d1b-326727bf8346', '591690ff-e41c-4e5a-a4ba-2ad387760aec'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "cinder-93821fad-29c5-4135-9107-6bb6899aa2c0-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-93821fad-29c5-4135-9107-6bb6899aa2c0-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:19 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:19 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "cinder-quobyte-93821fad-29c5-4135-9107-6bb6899aa2c0" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-quobyte-93821fad-29c5-4135-9107-6bb6899aa2c0" acquired by "delete_volume" :: waited 0.049s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:19 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e440721c-5df7-4bc0-9c97-8c340b4ed36f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-93821fad-29c5-4135-9107-6bb6899aa2c0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:20 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.529s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:20 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:20 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Deleted volume successfully. Sep 03 20:15:20 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-93821fad-29c5-4135-9107-6bb6899aa2c0 Sep 03 20:15:20 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-50b952e6-4459-44da-b4e3-1e90a35d2f52 tempest-TestStampPattern-813740280 None] Lock "cinder-8957f262-1c50-49c5-83e2-44d02c2ed7a2-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:20 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-93821fad-29c5-4135-9107-6bb6899aa2c0" returned: 0 in 1.195s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-93821fad-29c5-4135-9107-6bb6899aa2c0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:21 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-93821fad-29c5-4135-9107-6bb6899aa2c0 Sep 03 20:15:21 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:21 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-93821fad-29c5-4135-9107-6bb6899aa2c0" returned: 0 in 0.587s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-quobyte-93821fad-29c5-4135-9107-6bb6899aa2c0" released by "delete_volume" :: held 1.875s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:21 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Created reservations ['6b033109-d0d8-4925-a3ca-866289e5d95d', 'f1b8b8b9-28ba-47ad-9452-e8f5e81ff8f8', '7f048358-3a04-4566-b6d5-abc045f1fcef', '39de0182-1b13-4c78-ba47-35fd225e7472'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:21 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:21 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:22 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.494s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:22 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:22 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Deleted volume successfully. Sep 03 20:15:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2736d721-270b-4db0-a4c7-a12e13fb2935 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-93821fad-29c5-4135-9107-6bb6899aa2c0-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "cinder-3727c977-ac51-4bda-867d-19a4b5fffe3c-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-3727c977-ac51-4bda-867d-19a4b5fffe3c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "cinder-quobyte-3727c977-ac51-4bda-867d-19a4b5fffe3c" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-quobyte-3727c977-ac51-4bda-867d-19a4b5fffe3c" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:23 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[556c7b13-33be-4315-86cc-a3d10376a4d8]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3727c977-ac51-4bda-867d-19a4b5fffe3c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:23 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3727c977-ac51-4bda-867d-19a4b5fffe3c Sep 03 20:15:23 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:24 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3727c977-ac51-4bda-867d-19a4b5fffe3c" returned: 0 in 0.818s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3727c977-ac51-4bda-867d-19a4b5fffe3c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:24 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3727c977-ac51-4bda-867d-19a4b5fffe3c Sep 03 20:15:24 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:24 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3727c977-ac51-4bda-867d-19a4b5fffe3c" returned: 0 in 0.448s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-quobyte-3727c977-ac51-4bda-867d-19a4b5fffe3c" released by "delete_volume" :: held 1.362s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:24 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Created reservations ['f61bf014-dc58-447f-8174-f90f8d86334f', '87bc80c3-5adf-40cd-a66a-49feb9c42a08', 'ba35fb42-6d2b-4c2d-b8e6-fe4e06cf016e', '2c966e9f-d4f4-47ae-8cbe-ea91ba019054'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:24 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:24 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:25 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "cinder-c0ef6e4b-f5b8-4da4-a911-9172034df1b8-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.621s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:25 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:25 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Deleted volume successfully. Sep 03 20:15:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-c0ef6e4b-f5b8-4da4-a911-9172034df1b8-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4ff50e0e-a0ee-4142-9433-80f0ebbdcb7b tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-3727c977-ac51-4bda-867d-19a4b5fffe3c-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "cinder-quobyte-c0ef6e4b-f5b8-4da4-a911-9172034df1b8" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-quobyte-c0ef6e4b-f5b8-4da4-a911-9172034df1b8" acquired by "delete_volume" :: waited 0.045s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:25 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1820361-6069-4c65-863e-c16180769acb]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:26 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8 Sep 03 20:15:26 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:26 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8" returned: 0 in 0.990s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:26 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8 Sep 03 20:15:26 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:27 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c0ef6e4b-f5b8-4da4-a911-9172034df1b8" returned: 0 in 0.823s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-quobyte-c0ef6e4b-f5b8-4da4-a911-9172034df1b8" released by "delete_volume" :: held 1.911s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:27 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Created reservations ['c6d8ab66-cd9e-467b-ae8c-1f8897db2d25', 'c5d6b72e-24ba-4c64-8788-516f4fff0e39', '4a25a7e1-1d53-4f6e-8440-f3752b5cb809', 'cae213c1-f1a9-4a5f-9f57-4d2c7061d855'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:28 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:28 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "cinder-b85a747b-6ab0-43e7-b2db-1ddb460dd137-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-b85a747b-6ab0-43e7-b2db-1ddb460dd137-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "cinder-quobyte-b85a747b-6ab0-43e7-b2db-1ddb460dd137" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-quobyte-b85a747b-6ab0-43e7-b2db-1ddb460dd137" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:28 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dbfc16-e18a-4b9a-af37-d11e2e0e2212]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:28 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.441s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:28 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:28 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Deleted volume successfully. Sep 03 20:15:28 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137 Sep 03 20:15:28 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e1a75e49-13a0-44e5-8bc0-f5cfb04ae496 tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-c0ef6e4b-f5b8-4da4-a911-9172034df1b8-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:28 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137" returned: 0 in 0.616s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:29 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137 Sep 03 20:15:29 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:29 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b85a747b-6ab0-43e7-b2db-1ddb460dd137" returned: 0 in 0.687s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-quobyte-b85a747b-6ab0-43e7-b2db-1ddb460dd137" released by "delete_volume" :: held 1.400s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:29 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Created reservations ['70698a41-fecf-4da0-a891-de9674721721', 'adb8846e-9221-4ad4-85e3-105862e1c244', '021892ad-7e88-4fa5-a87f-c72fd959b588', 'd2c6900f-9804-4ffc-89ba-a0c2ca47079b'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:29 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:29 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:30 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.418s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:30 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:30 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Deleted volume successfully. Sep 03 20:15:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-530f866d-5583-4ca4-a618-d3894abd31cd tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-b85a747b-6ab0-43e7-b2db-1ddb460dd137-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "cinder-3796f819-86cc-4caa-9acf-c20f865af029-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-3796f819-86cc-4caa-9acf-c20f865af029-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "cinder-quobyte-3796f819-86cc-4caa-9acf-c20f865af029" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-quobyte-3796f819-86cc-4caa-9acf-c20f865af029" acquired by "delete_volume" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:30 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43573eb-8380-4d99-9cf4-2aba7d17f7e6]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3796f819-86cc-4caa-9acf-c20f865af029 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:31 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3796f819-86cc-4caa-9acf-c20f865af029 Sep 03 20:15:31 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:31 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3796f819-86cc-4caa-9acf-c20f865af029" returned: 0 in 0.570s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3796f819-86cc-4caa-9acf-c20f865af029 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:31 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3796f819-86cc-4caa-9acf-c20f865af029 Sep 03 20:15:31 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:31 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3796f819-86cc-4caa-9acf-c20f865af029" returned: 0 in 0.493s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-quobyte-3796f819-86cc-4caa-9acf-c20f865af029" released by "delete_volume" :: held 1.125s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:31 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Created reservations ['7325f2b1-97dc-416f-835d-e9033291e95c', '2cba7818-829f-4d74-b5cd-bb0aa8642303', '2d5f1d10-eb59-4f42-b73f-33a5ead420c8', '3c276031-30b7-4bb5-91ff-9f099e88c226'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:32 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:32 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:32 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.316s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:32 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:32 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Deleted volume successfully. Sep 03 20:15:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0e9423dd-3057-4261-992b-ad95e7ffacfb tempest-CreateVolumesFromImageTest-1515620649 None] Lock "cinder-3796f819-86cc-4caa-9acf-c20f865af029-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:15:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:36 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:36 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Flow 'volume_create_manager' (c54bfc93-9e88-43a8-a311-efc2106a9bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b53124c-1a5c-48f7-8418-60073e11fde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b53124c-1a5c-48f7-8418-60073e11fde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1255228390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510291ac-fcbb-4d31-8ac5-4bc5326f6a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6091953f9442d0aab16938037cc150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:37Z,use_quota=True,user_id='2f24746523174558a460553805320df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb90e799-8d4e-4f0e-a3e2-80f8aeaa2213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb90e799-8d4e-4f0e-a3e2-80f8aeaa2213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64395f2c-da2c-4cc8-a66c-9402ae111163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64395f2c-da2c-4cc8-a66c-9402ae111163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '510291ac-fcbb-4d31-8ac5-4bc5326f6a2b', 'volume_name': 'volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30521fe-59f9-452c-a354-267d57764b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30521fe-59f9-452c-a354-267d57764b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d28f3a-a5cd-4278-8703-2a7219901223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:37 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume 510291ac-fcbb-4d31-8ac5-4bc5326f6a2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b', 'volume_size': 1} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1255228390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510291ac-fcbb-4d31-8ac5-4bc5326f6a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6091953f9442d0aab16938037cc150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:37Z,use_quota=True,user_id='2f24746523174558a460553805320df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Creating volume 510291ac-fcbb-4d31-8ac5-4bc5326f6a2b {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:37 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:37 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.525s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:15:37 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b 1073741824 Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 28 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:15:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:15:37 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:37 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b 1073741824" returned: 0 in 0.750s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:38 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b Sep 03 20:15:38 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:38 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b" returned: 0 in 0.431s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d28f3a-a5cd-4278-8703-2a7219901223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb63e73a-a3ec-4b97-a773-14f85aa9cfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:38 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b (510291ac-fcbb-4d31-8ac5-4bc5326f6a2b): created successfully Sep 03 20:15:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb63e73a-a3ec-4b97-a773-14f85aa9cfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Flow 'volume_create_manager' (c54bfc93-9e88-43a8-a311-efc2106a9bf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:38 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-61c07bd6-2128-4fbc-9c63-fdee51f8aea3 tempest-CreateVolumesFromSnapshotTest-1093714 None] Created volume successfully. Sep 03 20:15:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] Creating offline snapshot 12dfb048-1732-4321-985b-2e247d705107 of volume 510291ac-fcbb-4d31-8ac5-4bc5326f6a2b {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:15:39 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df59e01-10d6-4d0e-b7ca-579f7b4bb6f9]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:39 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b Sep 03 20:15:39 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:40 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b" returned: 0 in 0.551s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:40 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 1G Sep 03 20:15:40 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:40 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 1G" returned: 0 in 0.502s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:40 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 Sep 03 20:15:40 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:40 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107" returned: 0 in 0.340s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:40 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 is being set with open permissions: ugo+rw Sep 03 20:15:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:40 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 Sep 03 20:15:40 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:41 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107" returned: 0 in 0.275s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:41 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.info Sep 03 20:15:41 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:41 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.info" returned: 0 in 0.318s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:41 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.info is being set with open permissions: ugo+rw Sep 03 20:15:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:41 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.info Sep 03 20:15:41 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-6faa465b-a2de-4b5f-bc76-d08838ee43e1 req-42446e8f-bc95-4a16-ac66-2954b1879533 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:41 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.info" returned: 0 in 0.262s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.392s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-6faa465b-a2de-4b5f-bc76-d08838ee43e1 req-42446e8f-bc95-4a16-ac66-2954b1879533 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.102s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-6faa465b-a2de-4b5f-bc76-d08838ee43e1 req-42446e8f-bc95-4a16-ac66-2954b1879533 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:41 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d17f63d0-526b-45e7-b492-bdd21db89080 tempest-CreateVolumesFromSnapshotTest-1093714 None] Create snapshot completed successfully Sep 03 20:15:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-6faa465b-a2de-4b5f-bc76-d08838ee43e1 req-42446e8f-bc95-4a16-ac66-2954b1879533 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bf7dd4d-981f-47a8-aa07-604a521a2fcd', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:15:41 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-6faa465b-a2de-4b5f-bc76-d08838ee43e1 req-42446e8f-bc95-4a16-ac66-2954b1879533 tempest-TestServerVolumeAttachmentScenario-1760028514 None] attachment_update completed successfully. Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Flow 'volume_create_manager' (2e2b1dbf-2b95-487d-893a-1d8f1b05b1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c7f32e-a42c-4ab4-bca0-7e89e88d5755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c7f32e-a42c-4ab4-bca0-7e89e88d5755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-651431505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64104dba-507f-40be-a484-fe4c76c4e033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6091953f9442d0aab16938037cc150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:43Z,use_quota=True,user_id='2f24746523174558a460553805320df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f9f372-b052-4f1f-ab86-6c2cf8d15734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f9f372-b052-4f1f-ab86-6c2cf8d15734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b586cef2-a98d-4883-a53d-a1c273abea9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b586cef2-a98d-4883-a53d-a1c273abea9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64104dba-507f-40be-a484-fe4c76c4e033', 'volume_name': 'volume-64104dba-507f-40be-a484-fe4c76c4e033', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fcb64a-e394-4f61-a375-83028b4cece1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fcb64a-e394-4f61-a375-83028b4cece1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3de5a41-00df-49cd-a73f-e983805d0fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:43 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume 64104dba-507f-40be-a484-fe4c76c4e033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64104dba-507f-40be-a484-fe4c76c4e033', 'volume_size': 1} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-651431505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64104dba-507f-40be-a484-fe4c76c4e033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6091953f9442d0aab16938037cc150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:43Z,use_quota=True,user_id='2f24746523174558a460553805320df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Creating volume 64104dba-507f-40be-a484-fe4c76c4e033 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:43 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-64104dba-507f-40be-a484-fe4c76c4e033 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:43 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-64104dba-507f-40be-a484-fe4c76c4e033 1073741824 Sep 03 20:15:43 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=94,cinder:INSERT=28,cinder:UPDATE=97,cinder:DELETE=9 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Flow 'volume_create_manager' (96db64d8-4aab-4887-a55d-a79b00836555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a9df2e-84de-40e7-843b-ab29e99240e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a9df2e-84de-40e7-843b-ab29e99240e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480580287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c5de48-4ea6-43e8-b539-cf54201def74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6091953f9442d0aab16938037cc150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:43Z,use_quota=True,user_id='2f24746523174558a460553805320df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4762930b-611f-425d-9c18-5231e8857cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4762930b-611f-425d-9c18-5231e8857cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adaa20e-e256-40ed-a689-b0c61c59760c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adaa20e-e256-40ed-a689-b0c61c59760c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91c5de48-4ea6-43e8-b539-cf54201def74', 'volume_name': 'volume-91c5de48-4ea6-43e8-b539-cf54201def74', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa07f6e-503d-4f30-9e3e-c728cedd91ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa07f6e-503d-4f30-9e3e-c728cedd91ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0e33df-5d8d-4af0-bb3b-f17b05613f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:43 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume 91c5de48-4ea6-43e8-b539-cf54201def74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91c5de48-4ea6-43e8-b539-cf54201def74', 'volume_size': 1} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:43 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-64104dba-507f-40be-a484-fe4c76c4e033 1073741824" returned: 0 in 0.688s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=106,cinder:UPDATE=126,cinder:INSERT=29,cinder:DELETE=11 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:15:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-64104dba-507f-40be-a484-fe4c76c4e033 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:43 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-64104dba-507f-40be-a484-fe4c76c4e033 Sep 03 20:15:43 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Flow 'volume_create_manager' (df6b30b0-e417-4c11-a07a-a1f84ba34433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2862137c-cf8c-4d14-8962-efd1bc0d15d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2862137c-cf8c-4d14-8962-efd1bc0d15d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2144480556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547a70e6-6f1c-405b-80ba-5fed0f0c9133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6091953f9442d0aab16938037cc150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:44Z,use_quota=True,user_id='2f24746523174558a460553805320df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9e4d89-8812-471a-9e83-c04eb8fe0f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9e4d89-8812-471a-9e83-c04eb8fe0f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d1afb6-9097-401d-a728-a11f75b3fbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d1afb6-9097-401d-a728-a11f75b3fbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '547a70e6-6f1c-405b-80ba-5fed0f0c9133', 'volume_name': 'volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1959b735-d359-4ac4-a227-58f28dd4eac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1959b735-d359-4ac4-a227-58f28dd4eac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a393b626-a2a9-41fe-939e-d648519a7220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:44 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume 547a70e6-6f1c-405b-80ba-5fed0f0c9133: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133', 'volume_size': 1} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:44 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-64104dba-507f-40be-a484-fe4c76c4e033" returned: 0 in 0.357s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480580287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c5de48-4ea6-43e8-b539-cf54201def74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6091953f9442d0aab16938037cc150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:43Z,use_quota=True,user_id='2f24746523174558a460553805320df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Creating volume 91c5de48-4ea6-43e8-b539-cf54201def74 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:44 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-91c5de48-4ea6-43e8-b539-cf54201def74 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:44 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-91c5de48-4ea6-43e8-b539-cf54201def74 1073741824 Sep 03 20:15:44 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3de5a41-00df-49cd-a73f-e983805d0fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64104dba-507f-40be-a484-fe4c76c4e033', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ef997b-4bec-48d7-bb34-39d06256531e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:44 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume volume-64104dba-507f-40be-a484-fe4c76c4e033 (64104dba-507f-40be-a484-fe4c76c4e033): created successfully Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ef997b-4bec-48d7-bb34-39d06256531e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Flow 'volume_create_manager' (2e2b1dbf-2b95-487d-893a-1d8f1b05b1d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:44 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a63c87da-0e99-4532-83c4-cc0fa2472108 tempest-CreateVolumesFromSnapshotTest-1093714 None] Created volume successfully. Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Flow 'volume_create_manager' (dd36c033-0b5b-466a-b76b-d01afaa4bd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0205d29-f322-4bb8-9206-a1f5e1641f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0205d29-f322-4bb8-9206-a1f5e1641f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476177679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8333cf2-87e8-4837-b84d-76055c9ff2e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6091953f9442d0aab16938037cc150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:44Z,use_quota=True,user_id='2f24746523174558a460553805320df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bd073d-f1c5-43a5-8fdd-b5e6c3675402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bd073d-f1c5-43a5-8fdd-b5e6c3675402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2678c3d-48c1-42c1-bed4-f8fedbe79e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2678c3d-48c1-42c1-bed4-f8fedbe79e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8333cf2-87e8-4837-b84d-76055c9ff2e6', 'volume_name': 'volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655abe25-6c2e-4799-980f-50b309d68fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655abe25-6c2e-4799-980f-50b309d68fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd893a6-91ac-40d3-8026-61bf5c0d27f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:44 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume d8333cf2-87e8-4837-b84d-76055c9ff2e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6', 'volume_size': 1} Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:44 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-91c5de48-4ea6-43e8-b539-cf54201def74 1073741824" returned: 0 in 0.682s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-91c5de48-4ea6-43e8-b539-cf54201def74 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:45 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-91c5de48-4ea6-43e8-b539-cf54201def74 Sep 03 20:15:45 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Flow 'volume_create_manager' (ddc50147-beb3-463c-9387-50418df65ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4056a191-ad7a-48c8-9d26-7560892311dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4056a191-ad7a-48c8-9d26-7560892311dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1790297096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6f6264-3f08-4ab4-9a4f-17703063e6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6091953f9442d0aab16938037cc150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:45Z,use_quota=True,user_id='2f24746523174558a460553805320df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f438ddd-5fd2-45f9-bb28-4972bd709f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f438ddd-5fd2-45f9-bb28-4972bd709f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026e1093-b15a-431f-ac72-dd69988a1525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026e1093-b15a-431f-ac72-dd69988a1525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca6f6264-3f08-4ab4-9a4f-17703063e6bd', 'volume_name': 'volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e6ed87-9f3d-48e7-a17e-41c57f8fe28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e6ed87-9f3d-48e7-a17e-41c57f8fe28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b84096f-f0de-43fb-8f3e-8f3d1730a728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:45 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume ca6f6264-3f08-4ab4-9a4f-17703063e6bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd', 'volume_size': 1} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:45 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-91c5de48-4ea6-43e8-b539-cf54201def74" returned: 0 in 0.339s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.238s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2144480556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547a70e6-6f1c-405b-80ba-5fed0f0c9133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6091953f9442d0aab16938037cc150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:44Z,use_quota=True,user_id='2f24746523174558a460553805320df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Creating volume 547a70e6-6f1c-405b-80ba-5fed0f0c9133 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:45 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0e33df-5d8d-4af0-bb3b-f17b05613f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91c5de48-4ea6-43e8-b539-cf54201def74', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2aeaa2-b155-4c12-86ca-bfcab3e5220f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:45 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133 1073741824 Sep 03 20:15:45 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:45 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume volume-91c5de48-4ea6-43e8-b539-cf54201def74 (91c5de48-4ea6-43e8-b539-cf54201def74): created successfully Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2aeaa2-b155-4c12-86ca-bfcab3e5220f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Flow 'volume_create_manager' (96db64d8-4aab-4887-a55d-a79b00836555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:45 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e40dc318-577a-47ee-a99d-3642c9c30255 tempest-CreateVolumesFromSnapshotTest-1093714 None] Created volume successfully. Sep 03 20:15:45 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133 1073741824" returned: 0 in 0.554s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:46 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133 Sep 03 20:15:46 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:46 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133" returned: 0 in 0.346s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.639s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476177679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8333cf2-87e8-4837-b84d-76055c9ff2e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6091953f9442d0aab16938037cc150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:44Z,use_quota=True,user_id='2f24746523174558a460553805320df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Creating volume d8333cf2-87e8-4837-b84d-76055c9ff2e6 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:46 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a393b626-a2a9-41fe-939e-d648519a7220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:46 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6 1073741824 Sep 03 20:15:46 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16113a05-fabe-49fe-9445-f7da54a92d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:46 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133 (547a70e6-6f1c-405b-80ba-5fed0f0c9133): created successfully Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16113a05-fabe-49fe-9445-f7da54a92d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Flow 'volume_create_manager' (df6b30b0-e417-4c11-a07a-a1f84ba34433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:46 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b2fd8d50-b6cc-4990-a46c-7189fcee22a5 tempest-CreateVolumesFromSnapshotTest-1093714 None] Created volume successfully. Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Flow 'volume_create_manager' (41cf30d6-4600-45a9-973b-2bc2643585ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aeb9037-b15a-43db-9c75-5a8355556afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aeb9037-b15a-43db-9c75-5a8355556afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f901fb-f8b9-4d22-85e4-d3ae0eb98308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8425cdf3394548886f5ffd6fc81a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:46Z,use_quota=True,user_id='60157d8102f24aabad4138ae59c07dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d332147-5a02-4144-9fe4-6ef34dd3659f),volume_type_id=0d332147-5a02-4144-9fe4-6ef34dd3659f)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d5f60c-770d-4c0e-9fc4-654d665ac53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d5f60c-770d-4c0e-9fc4-654d665ac53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d3ca70-1e09-46e0-9ca0-2c98720de903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.image.glance [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Creating Keystone auth plugin from conf {{(pid=87582) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-38efae60-0ea5-4916-a595-b9676d029603 req-d6898e19-e8e1-487d-b7d0-37ca26921f0b tempest-TestServerVolumeAttachmentScenario-1760028514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d3ca70-1e09-46e0-9ca0-2c98720de903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '14f901fb-f8b9-4d22-85e4-d3ae0eb98308', 'volume_name': 'volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308', 'volume_size': 1, 'image_id': 'fd1da504-8526-4898-b5da-0882654f741c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd1da504-8526-4898-b5da-0882654f741c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42abe0893f979fc0a8596a764f808cbd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f8425cdf3394548886f5ffd6fc81a51', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f53f0caa35ba20f834b976f3dfb53d00699495e29a5802b75bd2b28f404a90e00120853ad590f04cc15b6cfa726f64aa9a79dc655935f2cb19bfc475cabb22b1', 'id': 'fd1da504-8526-4898-b5da-0882654f741c', 'created_at': datetime.datetime(2026, 9, 3, 18, 15, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 15, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd1da504-8526-4898-b5da-0882654f741c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e341e9-7e31-43dc-950c-1e0feade0b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e341e9-7e31-43dc-950c-1e0feade0b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5037f86e-b946-46a0-94ca-6ca2813d93cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:46 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Volume 14f901fb-f8b9-4d22-85e4-d3ae0eb98308: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308', 'volume_size': 1, 'image_id': 'fd1da504-8526-4898-b5da-0882654f741c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd1da504-8526-4898-b5da-0882654f741c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42abe0893f979fc0a8596a764f808cbd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f8425cdf3394548886f5ffd6fc81a51', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f53f0caa35ba20f834b976f3dfb53d00699495e29a5802b75bd2b28f404a90e00120853ad590f04cc15b6cfa726f64aa9a79dc655935f2cb19bfc475cabb22b1', 'id': 'fd1da504-8526-4898-b5da-0882654f741c', 'created_at': datetime.datetime(2026, 9, 3, 18, 15, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 15, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd1da504-8526-4898-b5da-0882654f741c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Trying to clone 14f901fb-f8b9-4d22-85e4-d3ae0eb98308 from image fd1da504-8526-4898-b5da-0882654f741c at location (None, [{'url': 'file:///opt/stack/data/glance/images/fd1da504-8526-4898-b5da-0882654f741c', 'metadata': {}}]). {{(pid=87582) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 20:15:46 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6 1073741824" returned: 0 in 0.455s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 20:15:46 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Image download 0.00 MB at 0.00 MB/s Sep 03 20:15:46 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6 Sep 03 20:15:46 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1597426c-fde6-479e-a858-b6d69a4e91bb]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:47 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD Sep 03 20:15:47 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:47 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6" returned: 0 in 0.249s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.779s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1790297096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6f6264-3f08-4ab4-9a4f-17703063e6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6091953f9442d0aab16938037cc150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:45Z,use_quota=True,user_id='2f24746523174558a460553805320df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Creating volume ca6f6264-3f08-4ab4-9a4f-17703063e6bd {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:47 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd893a6-91ac-40d3-8026-61bf5c0d27f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:47 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd 1073741824 Sep 03 20:15:47 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af350422-f9ff-4a49-857a-1703a143c8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:47 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6 (d8333cf2-87e8-4837-b84d-76055c9ff2e6): created successfully Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af350422-f9ff-4a49-857a-1703a143c8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Flow 'volume_create_manager' (dd36c033-0b5b-466a-b76b-d01afaa4bd41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e8c0a9f7-325d-44e6-baee-3a04975c1a3c tempest-CreateVolumesFromSnapshotTest-1093714 None] Created volume successfully. Sep 03 20:15:47 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:47 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD Sep 03 20:15:47 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:47 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Temporary image fd1da504-8526-4898-b5da-0882654f741c is fetched for user 60157d8102f24aabad4138ae59c07dd9. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 20:15:47 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd 1073741824" returned: 0 in 0.565s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:47 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd Sep 03 20:15:47 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[790befc9-7410-4092-b2fa-35127fdaa60c]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:47 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD Sep 03 20:15:47 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:48 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd" returned: 0 in 0.378s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-38efae60-0ea5-4916-a595-b9676d029603 req-d6898e19-e8e1-487d-b7d0-37ca26921f0b tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.543s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b84096f-f0de-43fb-8f3e-8f3d1730a728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2036ec69-861a-4e72-aecc-04d5ebfd1674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-38efae60-0ea5-4916-a595-b9676d029603 req-d6898e19-e8e1-487d-b7d0-37ca26921f0b tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:48 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Volume volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd (ca6f6264-3f08-4ab4-9a4f-17703063e6bd): created successfully Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2036ec69-861a-4e72-aecc-04d5ebfd1674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Flow 'volume_create_manager' (ddc50147-beb3-463c-9387-50418df65ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:48 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-85ef8185-f12e-48fb-aeb2-82bdcd755dd9 tempest-CreateVolumesFromSnapshotTest-1093714 None] Created volume successfully. Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-38efae60-0ea5-4916-a595-b9676d029603 req-d6898e19-e8e1-487d-b7d0-37ca26921f0b tempest-TestServerVolumeAttachmentScenario-1760028514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-b3f4af9e-8fce-45c7-9620-fe131261a43a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24f82c67-7c1f-420f-aeda-5034bf79a23c', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:15:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-38efae60-0ea5-4916-a595-b9676d029603 req-d6898e19-e8e1-487d-b7d0-37ca26921f0b tempest-TestServerVolumeAttachmentScenario-1760028514 None] attachment_update completed successfully. Sep 03 20:15:48 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD Sep 03 20:15:48 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:48 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f901fb-f8b9-4d22-85e4-d3ae0eb98308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8425cdf3394548886f5ffd6fc81a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:15:46Z,use_quota=True,user_id='60157d8102f24aabad4138ae59c07dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d332147-5a02-4144-9fe4-6ef34dd3659f),volume_type_id=0d332147-5a02-4144-9fe4-6ef34dd3659f)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Creating volume 14f901fb-f8b9-4d22-85e4-d3ae0eb98308 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:15:48 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:48 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 1073741824 Sep 03 20:15:48 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-ca6f6264-3f08-4ab4-9a4f-17703063e6bd-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-ca6f6264-3f08-4ab4-9a4f-17703063e6bd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-quobyte-ca6f6264-3f08-4ab4-9a4f-17703063e6bd" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-ca6f6264-3f08-4ab4-9a4f-17703063e6bd" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4558f72-0752-4669-95e7-6a0b3c56c2aa]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:49 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd Sep 03 20:15:49 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:49 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 1073741824" returned: 0 in 0.571s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:49 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 Sep 03 20:15:49 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:49 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd" returned: 0 in 0.415s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:49 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd Sep 03 20:15:49 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:49 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308" returned: 0 in 0.284s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Attempting download of fd1da504-8526-4898-b5da-0882654f741c ((None, [{'url': 'file:///opt/stack/data/glance/images/fd1da504-8526-4898-b5da-0882654f741c', 'metadata': {}}])) to volume 14f901fb-f8b9-4d22-85e4-d3ae0eb98308. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e380d3-5f39-43af-a7f7-902a728d022f]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd1da504-8526-4898-b5da-0882654f741c_gy6om1ml {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:49 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ca6f6264-3f08-4ab4-9a4f-17703063e6bd" returned: 0 in 0.323s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-ca6f6264-3f08-4ab4-9a4f-17703063e6bd" released by "delete_volume" :: held 0.794s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:49 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd1da504-8526-4898-b5da-0882654f741c_gy6om1ml Sep 03 20:15:49 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Created reservations ['a3430478-a0b1-4c91-b9de-1b0ba5032b4d', 'b66c94cb-2d5e-49eb-b855-f5fad49853a8', 'c480f5bc-ebe8-4987-8d70-8ecf4ff92d08', '0f7e411f-3554-49f2-84ac-903c54a61fa9'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:49 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:49 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-d8333cf2-87e8-4837-b84d-76055c9ff2e6-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-d8333cf2-87e8-4837-b84d-76055c9ff2e6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-quobyte-d8333cf2-87e8-4837-b84d-76055c9ff2e6" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-d8333cf2-87e8-4837-b84d-76055c9ff2e6" acquired by "delete_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dcf423-6f9e-4a55-b224-3b37b7176170]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:50 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd1da504-8526-4898-b5da-0882654f741c_gy6om1ml" returned: 0 in 0.602s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd1da504-8526-4898-b5da-0882654f741c_gy6om1ml {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:50 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.500s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:50 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6 Sep 03 20:15:50 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Deleted volume successfully. Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-da85db0b-baa2-4de2-912e-9770bde975a7 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-ca6f6264-3f08-4ab4-9a4f-17703063e6bd-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:50 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd1da504-8526-4898-b5da-0882654f741c_gy6om1ml Sep 03 20:15:50 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-2c891341-9ee2-4e32-9629-471b4b980904 req-51af123b-2b88-41b4-9eab-25a7536a4bb1 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Terminate volume connection completed successfully. Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-2c891341-9ee2-4e32-9629-471b4b980904 req-51af123b-2b88-41b4-9eab-25a7536a4bb1 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Deleting attachment 24f82c67-7c1f-420f-aeda-5034bf79a23c. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:15:50 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6" returned: 0 in 0.474s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:50 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6 Sep 03 20:15:50 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:50 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd1da504-8526-4898-b5da-0882654f741c_gy6om1ml" returned: 1 in 0.482s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd1da504-8526-4898-b5da-0882654f741c_gy6om1ml' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e981057-91b3-4291-87a0-7b8f90df682a]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:50 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD Sep 03 20:15:50 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:50 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8333cf2-87e8-4837-b84d-76055c9ff2e6" returned: 0 in 0.275s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-d8333cf2-87e8-4837-b84d-76055c9ff2e6" released by "delete_volume" :: held 0.812s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Created reservations ['42f10bef-0b7d-4de5-8315-9255a5940d5c', 'a3077ae2-3ac2-49c0-8611-39c04ae811a3', 'e49abc87-d883-413c-a080-5ce2aa8e2f1e', 'f8d315c6-80e2-4660-a377-28466528a385'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:51 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:51 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:51 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:51 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD Sep 03 20:15:51 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:51 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-547a70e6-6f1c-405b-80ba-5fed0f0c9133-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.280s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:51 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Deleted volume successfully. Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-547a70e6-6f1c-405b-80ba-5fed0f0c9133-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-85a3456b-6c79-4707-81fd-562d19b3f41e tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-d8333cf2-87e8-4837-b84d-76055c9ff2e6-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-quobyte-547a70e6-6f1c-405b-80ba-5fed0f0c9133" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-547a70e6-6f1c-405b-80ba-5fed0f0c9133" acquired by "delete_volume" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[53854daf-70ba-40ed-99bc-f328779b9b4f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:51 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] fd1da504-8526-4898-b5da-0882654f741c was raw, converting to qcow2 {{(pid=87582) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:51 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 Sep 03 20:15:51 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:51 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133 Sep 03 20:15:51 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:51 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133" returned: 0 in 0.415s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:51 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133 Sep 03 20:15:51 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:52 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308" returned: 0 in 0.524s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fd1da504-8526-4898-b5da-0882654f741c_43ks6gxsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:15:52 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:52 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 1G Sep 03 20:15:52 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-9aafb26c-c825-46ce-a10c-90c4d8b4fabb req-52d424d5-82f0-49de-936f-44b519d30d55 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Terminate volume connection completed successfully. Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-9aafb26c-c825-46ce-a10c-90c4d8b4fabb req-52d424d5-82f0-49de-936f-44b519d30d55 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Deleting attachment 2bf7dd4d-981f-47a8-aa07-604a521a2fcd. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:15:52 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-547a70e6-6f1c-405b-80ba-5fed0f0c9133" returned: 0 in 0.272s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-547a70e6-6f1c-405b-80ba-5fed0f0c9133" released by "delete_volume" :: held 0.728s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Created reservations ['dfe47606-7053-4c0b-9182-5f2e3d6c0273', 'af24d732-8323-4e4f-96ae-4accd8197508', '898c98e0-295a-45c6-a0b3-e36f1d6d48ab', 'f02022a3-0aad-43f6-8085-2a6d5e91853f'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:52 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:52 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:52 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 1G" returned: 0 in 0.336s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Downloaded image fd1da504-8526-4898-b5da-0882654f741c ((None, [{'url': 'file:///opt/stack/data/glance/images/fd1da504-8526-4898-b5da-0882654f741c', 'metadata': {}}])) to volume 14f901fb-f8b9-4d22-85e4-d3ae0eb98308 successfully. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Temporary image fd1da504-8526-4898-b5da-0882654f741c for user 60157d8102f24aabad4138ae59c07dd9 is deleted. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Marking volume 14f901fb-f8b9-4d22-85e4-d3ae0eb98308 as bootable. {{(pid=87582) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Copying metadata from image fd1da504-8526-4898-b5da-0882654f741c to 14f901fb-f8b9-4d22-85e4-d3ae0eb98308. {{(pid=87582) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Creating volume glance metadata for volume 14f901fb-f8b9-4d22-85e4-d3ae0eb98308 backed by image fd1da504-8526-4898-b5da-0882654f741c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fd1da504-8526-4898-b5da-0882654f741c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '42abe0893f979fc0a8596a764f808cbd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87582) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5037f86e-b946-46a0-94ca-6ca2813d93cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308', 'volume_size': 1, 'image_id': 'fd1da504-8526-4898-b5da-0882654f741c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd1da504-8526-4898-b5da-0882654f741c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42abe0893f979fc0a8596a764f808cbd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f8425cdf3394548886f5ffd6fc81a51', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f53f0caa35ba20f834b976f3dfb53d00699495e29a5802b75bd2b28f404a90e00120853ad590f04cc15b6cfa726f64aa9a79dc655935f2cb19bfc475cabb22b1', 'id': 'fd1da504-8526-4898-b5da-0882654f741c', 'created_at': datetime.datetime(2026, 9, 3, 18, 15, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 15, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd1da504-8526-4898-b5da-0882654f741c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995bc903-94d5-4b87-8cd3-985f010890bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:15:52 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Volume volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 (14f901fb-f8b9-4d22-85e4-d3ae0eb98308): created successfully Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995bc903-94d5-4b87-8cd3-985f010890bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Flow 'volume_create_manager' (41cf30d6-4600-45a9-973b-2bc2643585ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:15:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-4379e617-7e4c-4611-88ee-0f3b5fe36f0e tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Created volume successfully. Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-91c5de48-4ea6-43e8-b539-cf54201def74-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-91c5de48-4ea6-43e8-b539-cf54201def74-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-quobyte-91c5de48-4ea6-43e8-b539-cf54201def74" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:52 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.272s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Deleted volume successfully. Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-91c5de48-4ea6-43e8-b539-cf54201def74" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-233fe642-062a-4dd4-817a-a7912b26ca3e tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-547a70e6-6f1c-405b-80ba-5fed0f0c9133-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5076d6a7-f378-481d-8333-fc5cc13e86bd]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-91c5de48-4ea6-43e8-b539-cf54201def74 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:52 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-91c5de48-4ea6-43e8-b539-cf54201def74 Sep 03 20:15:52 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Acquiring lock "cinder-14f901fb-f8b9-4d22-85e4-d3ae0eb98308-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Lock "cinder-14f901fb-f8b9-4d22-85e4-d3ae0eb98308-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Acquiring lock "cinder-quobyte-14f901fb-f8b9-4d22-85e4-d3ae0eb98308" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Lock "cinder-quobyte-14f901fb-f8b9-4d22-85e4-d3ae0eb98308" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:53 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-91c5de48-4ea6-43e8-b539-cf54201def74" returned: 0 in 0.401s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-91c5de48-4ea6-43e8-b539-cf54201def74 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac4f66c-6c63-467a-b7f3-262210fb4789]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:53 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-91c5de48-4ea6-43e8-b539-cf54201def74 Sep 03 20:15:53 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:53 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 Sep 03 20:15:53 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:53 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-91c5de48-4ea6-43e8-b539-cf54201def74" returned: 0 in 0.299s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-91c5de48-4ea6-43e8-b539-cf54201def74" released by "delete_volume" :: held 0.745s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Created reservations ['20278825-282b-4353-a734-1c672e5b0880', '4fbf308d-ef42-4050-a145-16435bdefe26', '2d5fe264-eced-4df8-9aee-e2c9edf66fec', '6c6c939c-db55-4a69-b45f-eb313b5e1dce'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:53 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308" returned: 0 in 0.575s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:53 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308 Sep 03 20:15:53 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:53 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:53 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-64104dba-507f-40be-a484-fe4c76c4e033-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-64104dba-507f-40be-a484-fe4c76c4e033-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-quobyte-64104dba-507f-40be-a484-fe4c76c4e033" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-64104dba-507f-40be-a484-fe4c76c4e033" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:54 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.404s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:54 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Deleted volume successfully. Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e4e515-7b21-471e-b87c-51bbf30b18e8]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-64104dba-507f-40be-a484-fe4c76c4e033 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:54 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3911d539-98f9-45a3-a44c-7c3a5dfb7c5c tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-91c5de48-4ea6-43e8-b539-cf54201def74-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-14f901fb-f8b9-4d22-85e4-d3ae0eb98308" returned: 0 in 0.450s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Lock "cinder-quobyte-14f901fb-f8b9-4d22-85e4-d3ae0eb98308" released by "delete_volume" :: held 1.089s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:54 devstack cinder-volume[87582]: WARNING cinder.quota [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:15:54 devstack cinder-volume[87582]: WARNING cinder.quota [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:15:54 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-64104dba-507f-40be-a484-fe4c76c4e033 Sep 03 20:15:54 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Created reservations ['fde0a7a4-525c-4b89-9c01-39e1747048fd', '0d837721-6f28-4f96-9585-a0b752bf8273', '2bdb6605-5b42-405d-b293-3864271adfee', 'f6c9f0bb-5fc9-468c-95f7-10bf14bd188e'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:54 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:54 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:54 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-64104dba-507f-40be-a484-fe4c76c4e033" returned: 0 in 0.450s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-64104dba-507f-40be-a484-fe4c76c4e033 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:54 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-64104dba-507f-40be-a484-fe4c76c4e033 Sep 03 20:15:54 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:54 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.393s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:54 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Deleted volume successfully. Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c9a91f4-6a92-451a-8455-7d9d6b27faa7 tempest-VolumeAndVolumeTypeFromImageTest-1614542448 None] Lock "cinder-14f901fb-f8b9-4d22-85e4-d3ae0eb98308-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:54 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-64104dba-507f-40be-a484-fe4c76c4e033" returned: 0 in 0.450s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-64104dba-507f-40be-a484-fe4c76c4e033" released by "delete_volume" :: held 0.986s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:55 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Created reservations ['724ca35e-1fb7-4eaf-b7d9-04408dd72fab', 'e1c20c8c-67f7-46bd-8f12-625264140849', '58157c7a-9972-43d4-b01e-22387af6ee02', '12d84fda-a6b7-4e48-823d-ea7abea6ecad'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:55 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:55 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:55 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.334s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:55 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:15:55 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Deleted volume successfully. Sep 03 20:15:55 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a6081482-8048-44cd-acc5-e3c61a95901d tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-64104dba-507f-40be-a484-fe4c76c4e033-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-87694a87-71ea-41ff-89cd-11afe72820d5 req-16e406e8-896e-47c4-98b0-8aa4bd44931e tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-87694a87-71ea-41ff-89cd-11afe72820d5 req-16e406e8-896e-47c4-98b0-8aa4bd44931e tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-87694a87-71ea-41ff-89cd-11afe72820d5 req-16e406e8-896e-47c4-98b0-8aa4bd44931e tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-87694a87-71ea-41ff-89cd-11afe72820d5 req-16e406e8-896e-47c4-98b0-8aa4bd44931e tempest-TestInstancesWithCinderVolumes-343188725 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-7f723398-5d28-4db4-8eaa-7a56f358a990', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0554b68f-00e1-42fc-b2c4-1b3f7c4b9dd8', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-12dfb048-1732-4321-985b-2e247d705107-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-12dfb048-1732-4321-985b-2e247d705107-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-quobyte-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-quobyte-12dfb048-1732-4321-985b-2e247d705107" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-87694a87-71ea-41ff-89cd-11afe72820d5 req-16e406e8-896e-47c4-98b0-8aa4bd44931e tempest-TestInstancesWithCinderVolumes-343188725 None] attachment_update completed successfully. Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-12dfb048-1732-4321-985b-2e247d705107" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Deleting offline snapshot 12dfb048-1732-4321-985b-2e247d705107 of volume 510291ac-fcbb-4d31-8ac5-4bc5326f6a2b {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] snapshot_file for this snap is: volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b55a0b-58ba-4f95-8286-a18db46f3d1d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:56 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 Sep 03 20:15:56 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:56 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107" returned: 0 in 0.464s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2534d834-1e43-47c7-afc4-fe806c1f965c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:57 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b Sep 03 20:15:57 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:57 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b" returned: 0 in 0.436s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:57 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 Sep 03 20:15:57 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:57 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107" returned: 0 in 0.422s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:57 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107 Sep 03 20:15:57 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:58 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b.12dfb048-1732-4321-985b-2e247d705107" returned: 0 in 0.326s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-12dfb048-1732-4321-985b-2e247d705107" released by "_delete_snapshot" :: held 1.820s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b" released by "delete_snapshot" :: held 1.856s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Created reservations ['668a7109-b246-4786-85dd-8ee24b1f32d8', 'fa9c7ba6-02f8-402d-97a1-b06ecd836b52', '698dad55-e54a-4f9f-b0b9-9b19e127ab8d', '5bae1587-3d2f-4e66-b175-b4b5f9fbabf6'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:58 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Delete snapshot completed successfully. Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6eeba1c0-2b5e-47bc-9f3b-87eb3a36248f tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-12dfb048-1732-4321-985b-2e247d705107-delete_snapshot" released by "delete_snapshot" :: held 2.080s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Acquiring lock "cinder-b3f4af9e-8fce-45c7-9620-fe131261a43a-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "cinder-b3f4af9e-8fce-45c7-9620-fe131261a43a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "cinder-quobyte-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Acquiring lock "cinder-quobyte-b3f4af9e-8fce-45c7-9620-fe131261a43a" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03c85ed-cfc6-401b-a458-be5296718dbb]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "cinder-quobyte-b3f4af9e-8fce-45c7-9620-fe131261a43a" acquired by "delete_volume" :: waited 0.036s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cc6d2a-9f50-46ff-9d34-5fec1fe8d072]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:15:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3f4af9e-8fce-45c7-9620-fe131261a43a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:58 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b Sep 03 20:15:58 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:58 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3f4af9e-8fce-45c7-9620-fe131261a43a Sep 03 20:15:58 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:59 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b" returned: 0 in 0.537s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:59 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b Sep 03 20:15:59 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:59 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3f4af9e-8fce-45c7-9620-fe131261a43a" returned: 0 in 0.515s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3f4af9e-8fce-45c7-9620-fe131261a43a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:59 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3f4af9e-8fce-45c7-9620-fe131261a43a Sep 03 20:15:59 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-03a0c98b-d2c1-4cfc-821b-3045562ae956 req-70182613-a193-4186-a417-48090a019bcb tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-03a0c98b-d2c1-4cfc-821b-3045562ae956 req-70182613-a193-4186-a417-48090a019bcb tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-03a0c98b-d2c1-4cfc-821b-3045562ae956 req-70182613-a193-4186-a417-48090a019bcb tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:59 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b" returned: 0 in 0.323s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-quobyte-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b" released by "delete_volume" :: held 0.954s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-03a0c98b-d2c1-4cfc-821b-3045562ae956 req-70182613-a193-4186-a417-48090a019bcb tempest-TestInstancesWithCinderVolumes-343188725 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b191ffa4-25ee-481f-a660-e1aa3653e7ef', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:15:59 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-b3f4af9e-8fce-45c7-9620-fe131261a43a" returned: 0 in 0.330s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "cinder-quobyte-b3f4af9e-8fce-45c7-9620-fe131261a43a" released by "delete_volume" :: held 0.928s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:15:59 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-03a0c98b-d2c1-4cfc-821b-3045562ae956 req-70182613-a193-4186-a417-48090a019bcb tempest-TestInstancesWithCinderVolumes-343188725 None] attachment_update completed successfully. Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Created reservations ['0807d87d-b18a-4ef8-81fa-8a2fc4b20f08', 'c2794983-590e-4152-a34b-7f41770ff94e', '248b6d9c-403a-4310-9bd3-7523c1170b67', '6cbafa41-9d1f-424b-ac03-b2e2fb2c8db3'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Created reservations ['76f54345-d212-465b-aa29-f21b647cabd0', 'ad580e12-6646-453b-9277-192dd33b9d8b', '2ed47ef2-db80-4538-8899-f158947a416c', '045c4a93-33df-4a39-9cd7-de8be57ef021'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:59 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:59 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:15:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:15:59 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:15:59 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:00 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:00 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.343s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:00 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.303s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:00 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:00 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Deleted volume successfully. Sep 03 20:16:00 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Deleted volume successfully. Sep 03 20:16:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e10c60e6-d62d-41a6-bff5-3e00f474ba85 tempest-CreateVolumesFromSnapshotTest-1093714 None] Lock "cinder-510291ac-fcbb-4d31-8ac5-4bc5326f6a2b-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c56cf9df-9183-469a-843a-74a9843db4ea tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "cinder-b3f4af9e-8fce-45c7-9620-fe131261a43a-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Acquiring lock "cinder-4db1d39a-58d0-4b92-b9c0-b0c32e648b91-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "cinder-4db1d39a-58d0-4b92-b9c0-b0c32e648b91-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Acquiring lock "cinder-quobyte-4db1d39a-58d0-4b92-b9c0-b0c32e648b91" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "cinder-quobyte-4db1d39a-58d0-4b92-b9c0-b0c32e648b91" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:00 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bf188c-222e-4df6-8e5b-cddffaf42f7c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:01 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91 Sep 03 20:16:01 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:01 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91" returned: 0 in 0.497s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:01 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91 Sep 03 20:16:01 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Flow 'volume_create_manager' (856abcda-f98c-4146-a9f0-d306396d6af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5e4442-393a-48c1-8ba2-9bbbabcd54ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5e4442-393a-48c1-8ba2-9bbbabcd54ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1880489911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65188a209f404abf80331741d6476b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:01Z,use_quota=True,user_id='f098f13cd37a48979f356dc2b4ddc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce025512-a5fd-4bcc-9a71-de2b4f4e70e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce025512-a5fd-4bcc-9a71-de2b4f4e70e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74e64f9-0cbc-4506-9b54-4f4d75480fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74e64f9-0cbc-4506-9b54-4f4d75480fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba', 'volume_name': 'volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601243e9-9f8a-41b0-9387-e74ff25b4229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601243e9-9f8a-41b0-9387-e74ff25b4229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e909400-8606-46ff-ab78-dc3e8a90e3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:01 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume 44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba', 'volume_size': 1} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1880489911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65188a209f404abf80331741d6476b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:01Z,use_quota=True,user_id='f098f13cd37a48979f356dc2b4ddc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Creating volume 44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:01 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:01 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba 1073741824 Sep 03 20:16:01 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:01 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4db1d39a-58d0-4b92-b9c0-b0c32e648b91" returned: 0 in 0.336s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "cinder-quobyte-4db1d39a-58d0-4b92-b9c0-b0c32e648b91" released by "delete_volume" :: held 0.889s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:01 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Created reservations ['c1f91c6f-65f1-460a-b4cd-ee2559a4486b', '67af7d60-65df-4bfe-97ac-2e43fa087bca', 'fb9996ec-1540-49b8-9478-bfdb0dd8ea19', 'af2df432-dc6d-444d-954e-51b599e35a48'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:02 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:02 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:02 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba 1073741824" returned: 0 in 0.699s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:02 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba Sep 03 20:16:02 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:02 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.409s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:02 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Deleted volume successfully. Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6fdfab08-3c70-4d30-8e43-05f03b070b42 tempest-TestServerVolumeAttachmentScenario-1760028514 None] Lock "cinder-4db1d39a-58d0-4b92-b9c0-b0c32e648b91-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:02 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba" returned: 0 in 0.311s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e909400-8606-46ff-ab78-dc3e8a90e3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b10ab5-8a95-4e41-85e7-6399596fe772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:02 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba (44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba): created successfully Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b10ab5-8a95-4e41-85e7-6399596fe772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Flow 'volume_create_manager' (856abcda-f98c-4146-a9f0-d306396d6af1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:02 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-cb612e71-08b4-4e53-94b2-4f5b8c123390 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Created volume successfully. Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Flow 'volume_create_manager' (1882a1cd-7cdb-408c-b1bc-6aec10bcc9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133fa9de-62ce-4c15-8cf4-9b4753aee599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133fa9de-62ce-4c15-8cf4-9b4753aee599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-546287906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2340b356-556a-4c7a-b89b-85e8101e3c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65188a209f404abf80331741d6476b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:04Z,use_quota=True,user_id='f098f13cd37a48979f356dc2b4ddc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b09d1e-4400-44ae-b76f-48c28fe75014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b09d1e-4400-44ae-b76f-48c28fe75014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2a1891-b731-407e-b167-ea0752fa48ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2a1891-b731-407e-b167-ea0752fa48ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2340b356-556a-4c7a-b89b-85e8101e3c52', 'volume_name': 'volume-2340b356-556a-4c7a-b89b-85e8101e3c52', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab392e83-925f-43fe-b4e2-7d20bf4ee3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab392e83-925f-43fe-b4e2-7d20bf4ee3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aada826d-3137-4cde-b6df-4f84ed12c0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:04 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume 2340b356-556a-4c7a-b89b-85e8101e3c52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2340b356-556a-4c7a-b89b-85e8101e3c52', 'volume_size': 1} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-546287906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2340b356-556a-4c7a-b89b-85e8101e3c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65188a209f404abf80331741d6476b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:04Z,use_quota=True,user_id='f098f13cd37a48979f356dc2b4ddc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Creating volume 2340b356-556a-4c7a-b89b-85e8101e3c52 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:04 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2340b356-556a-4c7a-b89b-85e8101e3c52 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:04 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2340b356-556a-4c7a-b89b-85e8101e3c52 1073741824 Sep 03 20:16:04 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:04 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Flow 'volume_create_manager' (b9f525fd-5cff-498b-b48b-f1bbd94329ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06af3834-272c-4069-a204-f3b83ae01844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06af3834-272c-4069-a204-f3b83ae01844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918088861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e930ba57-fe25-4a3f-814d-4b5723282d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65188a209f404abf80331741d6476b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:05Z,use_quota=True,user_id='f098f13cd37a48979f356dc2b4ddc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b947db-036d-4043-8a62-c5c0492de7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b947db-036d-4043-8a62-c5c0492de7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25744969-9329-41ab-84e1-21121b332b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:05 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25744969-9329-41ab-84e1-21121b332b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e930ba57-fe25-4a3f-814d-4b5723282d0c', 'volume_name': 'volume-e930ba57-fe25-4a3f-814d-4b5723282d0c', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba03219-4a1b-4dce-b9c9-7406ecfe51e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba03219-4a1b-4dce-b9c9-7406ecfe51e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177ad0a9-d10f-4b42-9e5e-310e6c322fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:05 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume e930ba57-fe25-4a3f-814d-4b5723282d0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e930ba57-fe25-4a3f-814d-4b5723282d0c', 'volume_size': 1} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2340b356-556a-4c7a-b89b-85e8101e3c52 1073741824" returned: 0 in 0.717s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2340b356-556a-4c7a-b89b-85e8101e3c52 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:05 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2340b356-556a-4c7a-b89b-85e8101e3c52 Sep 03 20:16:05 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:05 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Flow 'volume_create_manager' (2da2a214-d1cc-46e9-abcb-1dc26bedcbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3034ee84-a9d0-4bea-96b5-797b3e7524c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2340b356-556a-4c7a-b89b-85e8101e3c52" returned: 0 in 0.485s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.545s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918088861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e930ba57-fe25-4a3f-814d-4b5723282d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65188a209f404abf80331741d6476b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:05Z,use_quota=True,user_id='f098f13cd37a48979f356dc2b4ddc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Creating volume e930ba57-fe25-4a3f-814d-4b5723282d0c {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:05 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e930ba57-fe25-4a3f-814d-4b5723282d0c 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3034ee84-a9d0-4bea-96b5-797b3e7524c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1599756014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0159b464-359e-4522-9de0-e37c40267121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65188a209f404abf80331741d6476b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:06Z,use_quota=True,user_id='f098f13cd37a48979f356dc2b4ddc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef24df4-3668-4736-ac49-b40313e80430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef24df4-3668-4736-ac49-b40313e80430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035437e2-dabc-4309-9037-fa10d3585744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:05 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e930ba57-fe25-4a3f-814d-4b5723282d0c 1073741824 Sep 03 20:16:05 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035437e2-dabc-4309-9037-fa10d3585744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0159b464-359e-4522-9de0-e37c40267121', 'volume_name': 'volume-0159b464-359e-4522-9de0-e37c40267121', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afdecfe-2155-4668-a581-015ce408b002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afdecfe-2155-4668-a581-015ce408b002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec578d4-0634-4a2b-ab4f-ead3cc44c055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:05 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume 0159b464-359e-4522-9de0-e37c40267121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0159b464-359e-4522-9de0-e37c40267121', 'volume_size': 1} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aada826d-3137-4cde-b6df-4f84ed12c0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2340b356-556a-4c7a-b89b-85e8101e3c52', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d44b24f-21a9-444f-bb83-6b4fcc1e4381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:05 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume volume-2340b356-556a-4c7a-b89b-85e8101e3c52 (2340b356-556a-4c7a-b89b-85e8101e3c52): created successfully Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d44b24f-21a9-444f-bb83-6b4fcc1e4381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:05 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Flow 'volume_create_manager' (1882a1cd-7cdb-408c-b1bc-6aec10bcc9f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:05 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-75bc0387-c08b-46bc-ad25-1871ece6df97 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Created volume successfully. Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Flow 'volume_create_manager' (c03bcc59-b545-42fe-bad7-b512791f6629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0c5b7c-bfbf-4447-ae8c-afa99da550ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0c5b7c-bfbf-4447-ae8c-afa99da550ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-943422576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadc8da9-ec70-4944-945f-919f1f334458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65188a209f404abf80331741d6476b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:06Z,use_quota=True,user_id='f098f13cd37a48979f356dc2b4ddc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7894df0-5813-44db-a8f3-87ffa501bf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:06 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7894df0-5813-44db-a8f3-87ffa501bf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d11b49-baec-41b5-b7dc-ac663640fe5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d11b49-baec-41b5-b7dc-ac663640fe5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aadc8da9-ec70-4944-945f-919f1f334458', 'volume_name': 'volume-aadc8da9-ec70-4944-945f-919f1f334458', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce53e15a-cb70-4b6f-9e8a-20ef75202e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce53e15a-cb70-4b6f-9e8a-20ef75202e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51b1bb0-c87e-4165-8868-8e2ba681d820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:06 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume aadc8da9-ec70-4944-945f-919f1f334458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aadc8da9-ec70-4944-945f-919f1f334458', 'volume_size': 1} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e930ba57-fe25-4a3f-814d-4b5723282d0c 1073741824" returned: 0 in 0.820s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e930ba57-fe25-4a3f-814d-4b5723282d0c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:06 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e930ba57-fe25-4a3f-814d-4b5723282d0c Sep 03 20:16:06 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:06 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-8dbd008b-75e1-4652-86f5-a527c1572082 req-c944dfee-9bfa-43a7-8d7b-a52a581a88f6 tempest-TestInstancesWithCinderVolumes-343188725 None] Terminate volume connection completed successfully. Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-8dbd008b-75e1-4652-86f5-a527c1572082 req-c944dfee-9bfa-43a7-8d7b-a52a581a88f6 tempest-TestInstancesWithCinderVolumes-343188725 None] Deleting attachment 0554b68f-00e1-42fc-b2c4-1b3f7c4b9dd8. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:16:06 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Flow 'volume_create_manager' (d6a4ee24-d631-431e-b979-463e53821c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8f589a-99d5-4254-87bb-03bbb666ee6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e930ba57-fe25-4a3f-814d-4b5723282d0c" returned: 0 in 0.398s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.177s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1599756014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0159b464-359e-4522-9de0-e37c40267121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65188a209f404abf80331741d6476b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:06Z,use_quota=True,user_id='f098f13cd37a48979f356dc2b4ddc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Creating volume 0159b464-359e-4522-9de0-e37c40267121 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:06 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:16:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0159b464-359e-4522-9de0-e37c40267121 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177ad0a9-d10f-4b42-9e5e-310e6c322fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e930ba57-fe25-4a3f-814d-4b5723282d0c', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7114539-e037-483e-afd4-d87a0cb86c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:07 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0159b464-359e-4522-9de0-e37c40267121 1073741824 Sep 03 20:16:07 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8f589a-99d5-4254-87bb-03bbb666ee6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-911083832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9af743-d263-436c-9a68-d28d0ca2a694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65188a209f404abf80331741d6476b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:07Z,use_quota=True,user_id='f098f13cd37a48979f356dc2b4ddc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98b2440-3a63-4f02-ae94-74eed860f22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98b2440-3a63-4f02-ae94-74eed860f22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2f2822-b6e5-4b9b-938e-2a802a18dc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2f2822-b6e5-4b9b-938e-2a802a18dc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9af743-d263-436c-9a68-d28d0ca2a694', 'volume_name': 'volume-df9af743-d263-436c-9a68-d28d0ca2a694', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8e83d7-1635-4b4f-b571-77d23bf3bb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8e83d7-1635-4b4f-b571-77d23bf3bb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c91456-416a-41bb-a1f4-6ea292a64549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:07 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume df9af743-d263-436c-9a68-d28d0ca2a694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9af743-d263-436c-9a68-d28d0ca2a694', 'volume_size': 1} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:07 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume volume-e930ba57-fe25-4a3f-814d-4b5723282d0c (e930ba57-fe25-4a3f-814d-4b5723282d0c): created successfully Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7114539-e037-483e-afd4-d87a0cb86c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Flow 'volume_create_manager' (b9f525fd-5cff-498b-b48b-f1bbd94329ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:07 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ba85380d-4663-438f-9700-3ea9c8bf136f tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Created volume successfully. Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "cinder-7f723398-5d28-4db4-8eaa-7a56f358a990-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "cinder-7f723398-5d28-4db4-8eaa-7a56f358a990-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "cinder-quobyte-7f723398-5d28-4db4-8eaa-7a56f358a990" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "cinder-quobyte-7f723398-5d28-4db4-8eaa-7a56f358a990" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caa1e49-f178-4bc5-88f6-957a458abc4e]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7f723398-5d28-4db4-8eaa-7a56f358a990 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:07 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0159b464-359e-4522-9de0-e37c40267121 1073741824" returned: 0 in 0.735s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0159b464-359e-4522-9de0-e37c40267121 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:07 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7f723398-5d28-4db4-8eaa-7a56f358a990 Sep 03 20:16:07 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0159b464-359e-4522-9de0-e37c40267121 Sep 03 20:16:07 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:07 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:08 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7f723398-5d28-4db4-8eaa-7a56f358a990" returned: 0 in 0.595s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7f723398-5d28-4db4-8eaa-7a56f358a990 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:08 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7f723398-5d28-4db4-8eaa-7a56f358a990 Sep 03 20:16:08 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:08 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0159b464-359e-4522-9de0-e37c40267121" returned: 0 in 0.515s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.794s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-943422576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadc8da9-ec70-4944-945f-919f1f334458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65188a209f404abf80331741d6476b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:06Z,use_quota=True,user_id='f098f13cd37a48979f356dc2b4ddc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Creating volume aadc8da9-ec70-4944-945f-919f1f334458 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:08 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aadc8da9-ec70-4944-945f-919f1f334458 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec578d4-0634-4a2b-ab4f-ead3cc44c055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0159b464-359e-4522-9de0-e37c40267121', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:08 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aadc8da9-ec70-4944-945f-919f1f334458 1073741824 Sep 03 20:16:08 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4426229-3f1a-4c9b-ab09-a25bb1dcc535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:08 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume volume-0159b464-359e-4522-9de0-e37c40267121 (0159b464-359e-4522-9de0-e37c40267121): created successfully Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4426229-3f1a-4c9b-ab09-a25bb1dcc535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Flow 'volume_create_manager' (2da2a214-d1cc-46e9-abcb-1dc26bedcbcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9caf02c3-0e55-42aa-a7c0-e8b243fe342d tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Created volume successfully. Sep 03 20:16:08 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7f723398-5d28-4db4-8eaa-7a56f358a990" returned: 0 in 0.543s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "cinder-quobyte-7f723398-5d28-4db4-8eaa-7a56f358a990" released by "delete_volume" :: held 1.219s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:08 devstack cinder-volume[87582]: WARNING cinder.quota [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1759824094-643567602 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1759824094-643567602, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:16:08 devstack cinder-volume[87582]: WARNING cinder.quota [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1759824094-643567602 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1759824094-643567602, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:16:08 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Created reservations ['13c6a130-e73c-43b9-9f70-03beddde7ca7', 'b7fae749-902c-4060-9296-29ebd61c68d0', '5f196d29-b198-4ae0-9046-8cdf1bb6ea84', 'abfc2654-b011-4306-807d-40ab284c9e72'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:09 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:09 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:09 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aadc8da9-ec70-4944-945f-919f1f334458 1073741824" returned: 0 in 0.920s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aadc8da9-ec70-4944-945f-919f1f334458 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:09 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aadc8da9-ec70-4944-945f-919f1f334458 Sep 03 20:16:09 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:09 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.382s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:09 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Deleted volume successfully. Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-39cbbc9f-d817-4b13-81e1-342cfa61c5bc tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "cinder-7f723398-5d28-4db4-8eaa-7a56f358a990-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:09 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aadc8da9-ec70-4944-945f-919f1f334458" returned: 0 in 0.363s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.597s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-911083832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9af743-d263-436c-9a68-d28d0ca2a694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65188a209f404abf80331741d6476b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:07Z,use_quota=True,user_id='f098f13cd37a48979f356dc2b4ddc34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Creating volume df9af743-d263-436c-9a68-d28d0ca2a694 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:09 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-df9af743-d263-436c-9a68-d28d0ca2a694 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51b1bb0-c87e-4165-8868-8e2ba681d820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aadc8da9-ec70-4944-945f-919f1f334458', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:09 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-df9af743-d263-436c-9a68-d28d0ca2a694 1073741824 Sep 03 20:16:09 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dbc0a9-d697-4815-b3ab-92314daa1e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:09 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume volume-aadc8da9-ec70-4944-945f-919f1f334458 (aadc8da9-ec70-4944-945f-919f1f334458): created successfully Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dbc0a9-d697-4815-b3ab-92314daa1e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Flow 'volume_create_manager' (c03bcc59-b545-42fe-bad7-b512791f6629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:09 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d720a74c-0fdd-41e9-8a8c-eecaae7fc39b tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Created volume successfully. Sep 03 20:16:10 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-df9af743-d263-436c-9a68-d28d0ca2a694 1073741824" returned: 0 in 0.675s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-df9af743-d263-436c-9a68-d28d0ca2a694 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:10 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-df9af743-d263-436c-9a68-d28d0ca2a694 Sep 03 20:16:10 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:10 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-df9af743-d263-436c-9a68-d28d0ca2a694" returned: 0 in 0.324s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:16:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c91456-416a-41bb-a1f4-6ea292a64549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9af743-d263-436c-9a68-d28d0ca2a694', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecefbe0-3b2c-4274-9977-96876b129e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:10 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Volume volume-df9af743-d263-436c-9a68-d28d0ca2a694 (df9af743-d263-436c-9a68-d28d0ca2a694): created successfully Sep 03 20:16:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecefbe0-3b2c-4274-9977-96876b129e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Flow 'volume_create_manager' (d6a4ee24-d631-431e-b979-463e53821c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:10 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a28f1ace-4fd3-4bf0-9df7-5f6aa7674b32 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Created volume successfully. Sep 03 20:16:11 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "cinder-df9af743-d263-436c-9a68-d28d0ca2a694-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:11 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-df9af743-d263-436c-9a68-d28d0ca2a694-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:11 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "cinder-quobyte-df9af743-d263-436c-9a68-d28d0ca2a694" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:11 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-quobyte-df9af743-d263-436c-9a68-d28d0ca2a694" acquired by "delete_volume" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:11 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b43b803-15c2-40d8-be02-ef7df5ab603e]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-df9af743-d263-436c-9a68-d28d0ca2a694 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:12 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-df9af743-d263-436c-9a68-d28d0ca2a694 Sep 03 20:16:12 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:12 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-25bfe147-53b8-49d8-b16a-a7d7c0a75d7c req-9d80032c-2b60-4592-9970-7b2b4741bdb1 tempest-TestInstancesWithCinderVolumes-343188725 None] Terminate volume connection completed successfully. Sep 03 20:16:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-25bfe147-53b8-49d8-b16a-a7d7c0a75d7c req-9d80032c-2b60-4592-9970-7b2b4741bdb1 tempest-TestInstancesWithCinderVolumes-343188725 None] Deleting attachment b191ffa4-25ee-481f-a660-e1aa3653e7ef. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:16:12 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-df9af743-d263-436c-9a68-d28d0ca2a694" returned: 0 in 0.509s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-df9af743-d263-436c-9a68-d28d0ca2a694 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:12 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-df9af743-d263-436c-9a68-d28d0ca2a694 Sep 03 20:16:12 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:12 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-df9af743-d263-436c-9a68-d28d0ca2a694" returned: 0 in 0.334s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-quobyte-df9af743-d263-436c-9a68-d28d0ca2a694" released by "delete_volume" :: held 0.900s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:12 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Created reservations ['0b72a192-1519-403d-85c5-2373ea7cedf6', '7a644e45-fb75-42f1-9d49-bab767d8019d', 'bd61550c-4b67-4464-9b98-2f0039068e82', '8e03f67e-8913-4db5-bac7-f8de00fe2084'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "cinder-dba4b70c-2ada-4ba5-be7f-99607152bb0d-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "cinder-dba4b70c-2ada-4ba5-be7f-99607152bb0d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "cinder-quobyte-dba4b70c-2ada-4ba5-be7f-99607152bb0d" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "cinder-aadc8da9-ec70-4944-945f-919f1f334458-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:13 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:13 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "cinder-quobyte-dba4b70c-2ada-4ba5-be7f-99607152bb0d" acquired by "delete_volume" :: waited 0.033s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-aadc8da9-ec70-4944-945f-919f1f334458-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b2a23c-f9d4-4e03-8e76-1560e61fba74]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "cinder-quobyte-aadc8da9-ec70-4944-945f-919f1f334458" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-quobyte-aadc8da9-ec70-4944-945f-919f1f334458" acquired by "delete_volume" :: waited 0.037s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b7ba1f-5cdc-4e80-9d5c-15632da4cb2a]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aadc8da9-ec70-4944-945f-919f1f334458 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:13 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.315s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:13 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d Sep 03 20:16:13 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:13 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Deleted volume successfully. Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-bdcb9616-6507-45c0-b599-d1070e16758e tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-df9af743-d263-436c-9a68-d28d0ca2a694-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:13 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aadc8da9-ec70-4944-945f-919f1f334458 Sep 03 20:16:13 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:13 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d" returned: 0 in 0.671s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:13 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d Sep 03 20:16:13 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:13 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aadc8da9-ec70-4944-945f-919f1f334458" returned: 0 in 0.732s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aadc8da9-ec70-4944-945f-919f1f334458 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:14 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aadc8da9-ec70-4944-945f-919f1f334458 Sep 03 20:16:14 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:14 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dba4b70c-2ada-4ba5-be7f-99607152bb0d" returned: 0 in 0.355s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "cinder-quobyte-dba4b70c-2ada-4ba5-be7f-99607152bb0d" released by "delete_volume" :: held 1.096s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:14 devstack cinder-volume[87582]: WARNING cinder.quota [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-927873829-495405606 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-927873829-495405606, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:16:14 devstack cinder-volume[87582]: WARNING cinder.quota [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-927873829-495405606 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-927873829-495405606, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Created reservations ['dec4a961-aa63-471f-82d9-f21697ada11b', '4b440e4d-78e5-416d-903e-4f32c4d56b1c', '69aa181f-5679-4057-8025-f1ca05acf666', '57e7cac9-9a22-4a65-b8e0-e44ff1c2a1e4'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:14 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aadc8da9-ec70-4944-945f-919f1f334458" returned: 0 in 0.388s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-quobyte-aadc8da9-ec70-4944-945f-919f1f334458" released by "delete_volume" :: held 1.204s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Created reservations ['29378ffb-10c3-46f2-879c-34ac4f7b43f0', 'fb604377-0239-4f1f-ba6b-2f2b268069c7', '2efc6dc3-4c3b-47bd-9b85-3a8671de8ea4', 'e95355ae-4f87-4fb4-8c34-4439b937d409'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:14 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:14 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:14 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:14 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:14 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.352s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:14 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Deleted volume successfully. Sep 03 20:16:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9267194b-f02d-47a2-9c1f-0a69a88d127a tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "cinder-dba4b70c-2ada-4ba5-be7f-99607152bb0d-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:15 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.417s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:15 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:15 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Deleted volume successfully. Sep 03 20:16:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f057bb8c-02d3-46cf-a0fc-35b80466ab99 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-aadc8da9-ec70-4944-945f-919f1f334458-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "cinder-0159b464-359e-4522-9de0-e37c40267121-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-0159b464-359e-4522-9de0-e37c40267121-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "cinder-quobyte-0159b464-359e-4522-9de0-e37c40267121" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-quobyte-0159b464-359e-4522-9de0-e37c40267121" acquired by "delete_volume" :: waited 0.039s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:15 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[082ad692-8fcf-4a40-8368-0e77ea4a8d0f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0159b464-359e-4522-9de0-e37c40267121 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:15 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0159b464-359e-4522-9de0-e37c40267121 Sep 03 20:16:15 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:16 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0159b464-359e-4522-9de0-e37c40267121" returned: 0 in 0.479s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0159b464-359e-4522-9de0-e37c40267121 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:16 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0159b464-359e-4522-9de0-e37c40267121 Sep 03 20:16:16 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:16 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0159b464-359e-4522-9de0-e37c40267121" returned: 0 in 0.297s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-quobyte-0159b464-359e-4522-9de0-e37c40267121" released by "delete_volume" :: held 0.869s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:16 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Created reservations ['6748b745-90a7-4be2-abfc-7c90bc4adea9', '3ee27936-05cd-492d-b0c6-c1e137886245', '1009e1e7-2cac-4e4b-8081-94a8dabe0b81', '486758dd-8911-46ee-8a2c-a1effec81515'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:16 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:16 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:17 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.351s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:17 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:17 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Deleted volume successfully. Sep 03 20:16:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5fb3d5d2-2eaf-4c1a-89c4-790b8ea4f033 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-0159b464-359e-4522-9de0-e37c40267121-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "cinder-e930ba57-fe25-4a3f-814d-4b5723282d0c-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-e930ba57-fe25-4a3f-814d-4b5723282d0c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "cinder-quobyte-e930ba57-fe25-4a3f-814d-4b5723282d0c" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-quobyte-e930ba57-fe25-4a3f-814d-4b5723282d0c" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:18 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca21c201-1be1-4173-a3c5-0d66026fdae3]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e930ba57-fe25-4a3f-814d-4b5723282d0c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:18 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e930ba57-fe25-4a3f-814d-4b5723282d0c Sep 03 20:16:18 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:18 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e930ba57-fe25-4a3f-814d-4b5723282d0c" returned: 0 in 0.494s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e930ba57-fe25-4a3f-814d-4b5723282d0c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:18 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e930ba57-fe25-4a3f-814d-4b5723282d0c Sep 03 20:16:18 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:19 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e930ba57-fe25-4a3f-814d-4b5723282d0c" returned: 0 in 0.629s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-quobyte-e930ba57-fe25-4a3f-814d-4b5723282d0c" released by "delete_volume" :: held 1.191s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:19 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Created reservations ['e95ace85-98f0-42de-8920-3405d46f3256', '84c84e7c-e62d-4267-bf02-bae92df4d16a', '39d64912-37c2-45c8-9d40-c3a3c3f8c98c', 'd93b933c-1388-4140-83cb-aa52785095ae'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:19 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:19 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:19 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:19 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-5afa35e1-4081-47f9-ad10-e011093be17d req-b45ec8c0-cfe0-45ce-b577-7b4fd263c888 tempest-TestInstancesWithCinderVolumes-343188725 None] Terminate volume connection completed successfully. Sep 03 20:16:19 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-5afa35e1-4081-47f9-ad10-e011093be17d req-b45ec8c0-cfe0-45ce-b577-7b4fd263c888 tempest-TestInstancesWithCinderVolumes-343188725 None] Deleting attachment fc87a53d-b7fe-4733-a2b8-a3dbfd49b129. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:16:19 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.315s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:19 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:19 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Deleted volume successfully. Sep 03 20:16:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9bbf0296-9c73-467f-a0e0-6d442de2b742 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-e930ba57-fe25-4a3f-814d-4b5723282d0c-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "cinder-2340b356-556a-4c7a-b89b-85e8101e3c52-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-2340b356-556a-4c7a-b89b-85e8101e3c52-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "cinder-quobyte-2340b356-556a-4c7a-b89b-85e8101e3c52" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-quobyte-2340b356-556a-4c7a-b89b-85e8101e3c52" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfa217f-a362-47de-8621-6908081e9dc5]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2340b356-556a-4c7a-b89b-85e8101e3c52 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:20 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2340b356-556a-4c7a-b89b-85e8101e3c52 Sep 03 20:16:20 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "cinder-d8694ad4-595e-4ae5-9f6d-88b978a738e7-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "cinder-d8694ad4-595e-4ae5-9f6d-88b978a738e7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "cinder-quobyte-d8694ad4-595e-4ae5-9f6d-88b978a738e7" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "cinder-quobyte-d8694ad4-595e-4ae5-9f6d-88b978a738e7" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54e2ee8-3c05-469d-9214-9c3853b182ae]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:20 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2340b356-556a-4c7a-b89b-85e8101e3c52" returned: 0 in 0.417s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2340b356-556a-4c7a-b89b-85e8101e3c52 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:20 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2340b356-556a-4c7a-b89b-85e8101e3c52 Sep 03 20:16:20 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:20 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 Sep 03 20:16:20 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:21 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2340b356-556a-4c7a-b89b-85e8101e3c52" returned: 0 in 0.273s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-quobyte-2340b356-556a-4c7a-b89b-85e8101e3c52" released by "delete_volume" :: held 0.733s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Created reservations ['b55f2671-4074-4029-a201-3a79ad8ddd38', 'b721eb7b-2d9b-4303-9aac-775e11379672', '766e4972-285c-480a-bed6-459c98c75cd3', 'bccf80d0-8465-499a-8212-c0833f7a29a5'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:21 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7" returned: 0 in 0.424s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:21 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7 Sep 03 20:16:21 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:21 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:21 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Flow 'volume_create_manager' (45bc1b2c-519c-4115-a461-ead5dc9b0d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1ab035-bdf9-4080-a95b-9b2789281e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1ab035-bdf9-4080-a95b-9b2789281e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1183294044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=504c437a-51fd-43ee-a98a-8528f87411a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5521becd4744749f4f7c85142ed6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:21Z,use_quota=True,user_id='7706a025d45d47c0aa6ccde86c4fc5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834513c2-5b70-4d35-bba4-e77d84c8b71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834513c2-5b70-4d35-bba4-e77d84c8b71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f381d4-539b-481b-91be-483163354592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f381d4-539b-481b-91be-483163354592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '504c437a-51fd-43ee-a98a-8528f87411a4', 'volume_name': 'volume-504c437a-51fd-43ee-a98a-8528f87411a4', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8c6b08-d4ba-40e3-ab3e-2a33aec3e8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8c6b08-d4ba-40e3-ab3e-2a33aec3e8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26589549-4806-4596-9a9d-a0945befc323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:21 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Volume 504c437a-51fd-43ee-a98a-8528f87411a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-504c437a-51fd-43ee-a98a-8528f87411a4', 'volume_size': 1} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1183294044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=504c437a-51fd-43ee-a98a-8528f87411a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5521becd4744749f4f7c85142ed6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:21Z,use_quota=True,user_id='7706a025d45d47c0aa6ccde86c4fc5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Creating volume 504c437a-51fd-43ee-a98a-8528f87411a4 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:21 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-504c437a-51fd-43ee-a98a-8528f87411a4 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:21 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "cinder-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d8694ad4-595e-4ae5-9f6d-88b978a738e7" returned: 0 in 0.316s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:21 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-504c437a-51fd-43ee-a98a-8528f87411a4 1073741824 Sep 03 20:16:21 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "cinder-quobyte-d8694ad4-595e-4ae5-9f6d-88b978a738e7" released by "delete_volume" :: held 0.814s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:21 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "cinder-quobyte-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.337s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:21 devstack cinder-volume[87582]: WARNING cinder.quota [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-78054517-1457481250 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-78054517-1457481250, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:16:21 devstack cinder-volume[87582]: WARNING cinder.quota [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-78054517-1457481250 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-78054517-1457481250, it is now deprecated. Please use the default quota class for default quota. Sep 03 20:16:21 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Deleted volume successfully. Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-quobyte-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba" acquired by "delete_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Created reservations ['3b6e242f-bf9a-425f-9f9b-ef4c00831963', '7f82fa62-6780-4ecf-8006-513daae36cbb', 'ea11c43e-5645-4429-96ed-3fee54dbea2b', 'fd940fb5-a05a-4e86-aa5e-c4cb633205be'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ec9eebb6-fc8f-4b36-9323-8d418d5965bb tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-2340b356-556a-4c7a-b89b-85e8101e3c52-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cbc375-b9a3-46dd-903a-92407ae2e2a9]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:21 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:21 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:21 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba Sep 03 20:16:21 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:22 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-504c437a-51fd-43ee-a98a-8528f87411a4 1073741824" returned: 0 in 0.540s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:22 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.289s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:22 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Deleted volume successfully. Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-504c437a-51fd-43ee-a98a-8528f87411a4 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:22 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-504c437a-51fd-43ee-a98a-8528f87411a4 Sep 03 20:16:22 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-87e031c7-48dc-4fb0-86e4-9a32046fabeb tempest-TestInstancesWithCinderVolumes-343188725 None] Lock "cinder-d8694ad4-595e-4ae5-9f6d-88b978a738e7-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:22 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba" returned: 0 in 0.453s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:22 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba Sep 03 20:16:22 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:22 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-504c437a-51fd-43ee-a98a-8528f87411a4" returned: 0 in 0.273s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26589549-4806-4596-9a9d-a0945befc323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-504c437a-51fd-43ee-a98a-8528f87411a4', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9155996-7163-42ce-b39b-a313dac34c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:22 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Volume volume-504c437a-51fd-43ee-a98a-8528f87411a4 (504c437a-51fd-43ee-a98a-8528f87411a4): created successfully Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9155996-7163-42ce-b39b-a313dac34c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Flow 'volume_create_manager' (45bc1b2c-519c-4115-a461-ead5dc9b0d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:22 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba" returned: 0 in 0.285s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:22 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ee0456b3-6212-41a1-9930-3914ce87761a tempest-ProjectReaderTests-1020635530 None] Created volume successfully. Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-quobyte-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba" released by "delete_volume" :: held 0.795s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Created reservations ['4dcfdce1-b8b3-4945-a5b5-2ed4c45544b4', '4ef78b0b-93b6-454f-b7c8-8d66ff7e674f', '9abfcc5e-93f1-489c-af65-d7ee4154ed10', '6d32b3ec-df22-4f22-a09f-1126f51c8665'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:22 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:22 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:22 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.284s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:22 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Deleted volume successfully. Sep 03 20:16:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a6df90c0-6de1-46fa-9772-4aee264bc761 tempest-CreateVolumesFromSourceVolumeTest-784882326 None] Lock "cinder-44e0d5bd-2222-4e7f-97fb-e3ba1a7c95ba-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Acquiring lock "cinder-504c437a-51fd-43ee-a98a-8528f87411a4-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Lock "cinder-504c437a-51fd-43ee-a98a-8528f87411a4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Acquiring lock "cinder-quobyte-504c437a-51fd-43ee-a98a-8528f87411a4" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Lock "cinder-quobyte-504c437a-51fd-43ee-a98a-8528f87411a4" acquired by "delete_volume" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:23 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6332fa50-fe4c-4daa-ac2e-d593b7dab3e2]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-504c437a-51fd-43ee-a98a-8528f87411a4 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:24 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-504c437a-51fd-43ee-a98a-8528f87411a4 Sep 03 20:16:24 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:24 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-504c437a-51fd-43ee-a98a-8528f87411a4" returned: 0 in 0.415s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-504c437a-51fd-43ee-a98a-8528f87411a4 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:24 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-504c437a-51fd-43ee-a98a-8528f87411a4 Sep 03 20:16:24 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:24 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-504c437a-51fd-43ee-a98a-8528f87411a4" returned: 0 in 0.322s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Lock "cinder-quobyte-504c437a-51fd-43ee-a98a-8528f87411a4" released by "delete_volume" :: held 0.789s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:24 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Created reservations ['7679cda5-20c1-42b6-bfbd-8c1d939c1e51', '88ed0701-e299-4170-bc2f-280454b936bd', 'ec6de72a-dd60-4971-815e-67bd26ca4dfd', 'a74e4e92-9db2-4f3d-9199-7aeb94afcae3'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:24 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:24 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:25 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.313s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:25 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Deleted volume successfully. Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5b8fb88a-c6f9-47d0-92c1-99a49cbf77ce tempest-ProjectReaderTests-1020635530 None] Lock "cinder-504c437a-51fd-43ee-a98a-8528f87411a4-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Flow 'volume_create_manager' (ea6446c1-54c7-45d0-ab78-59d021861dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec835de-6459-4c03-a793-235f005e82b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec835de-6459-4c03-a793-235f005e82b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-630166979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa339221-f9d1-4faa-90b0-e58cd8d53364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5521becd4744749f4f7c85142ed6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:25Z,use_quota=True,user_id='7706a025d45d47c0aa6ccde86c4fc5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26bf428-bf06-4aa8-943d-a110e3f1b8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26bf428-bf06-4aa8-943d-a110e3f1b8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e58e65c-e826-4a60-87d0-84dc21b64d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e58e65c-e826-4a60-87d0-84dc21b64d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa339221-f9d1-4faa-90b0-e58cd8d53364', 'volume_name': 'volume-aa339221-f9d1-4faa-90b0-e58cd8d53364', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e70ccad-776f-405a-967e-6e8800c6a55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e70ccad-776f-405a-967e-6e8800c6a55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea853ad-58e4-44e5-9ae2-99beafdcec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:25 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Volume aa339221-f9d1-4faa-90b0-e58cd8d53364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa339221-f9d1-4faa-90b0-e58cd8d53364', 'volume_size': 1} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-630166979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa339221-f9d1-4faa-90b0-e58cd8d53364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa5521becd4744749f4f7c85142ed6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:25Z,use_quota=True,user_id='7706a025d45d47c0aa6ccde86c4fc5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Creating volume aa339221-f9d1-4faa-90b0-e58cd8d53364 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:25 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:16:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa339221-f9d1-4faa-90b0-e58cd8d53364 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:25 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa339221-f9d1-4faa-90b0-e58cd8d53364 1073741824 Sep 03 20:16:25 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:26 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa339221-f9d1-4faa-90b0-e58cd8d53364 1073741824" returned: 0 in 0.466s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Flow 'volume_create_manager' (bc751c3f-18b4-4fa1-9d3c-8bc460c4c35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574766ee-162b-4ea9-8b5d-98a156c36e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574766ee-162b-4ea9-8b5d-98a156c36e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1165827964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed49b1b-0b05-400b-9b03-e2d57ab52dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3d4a1b959141fb8bc31850f309ecaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:26Z,use_quota=True,user_id='df49c179fa504e769ada82abef73ade8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f083b2-e04a-4f29-bbd1-e7466fe24b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f083b2-e04a-4f29-bbd1-e7466fe24b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e7e109-d1cf-439c-9a40-660c29c7d66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e7e109-d1cf-439c-9a40-660c29c7d66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed49b1b-0b05-400b-9b03-e2d57ab52dff', 'volume_name': 'volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11ce58c-5c9c-4976-8014-7580190a4ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11ce58c-5c9c-4976-8014-7580190a4ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5de6064-b63d-46dc-9bd2-2a6f3341ed00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:26 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Volume 9ed49b1b-0b05-400b-9b03-e2d57ab52dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff', 'volume_size': 1} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa339221-f9d1-4faa-90b0-e58cd8d53364 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:26 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa339221-f9d1-4faa-90b0-e58cd8d53364 Sep 03 20:16:26 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:26 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa339221-f9d1-4faa-90b0-e58cd8d53364" returned: 0 in 0.248s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.257s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1165827964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed49b1b-0b05-400b-9b03-e2d57ab52dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3d4a1b959141fb8bc31850f309ecaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:26Z,use_quota=True,user_id='df49c179fa504e769ada82abef73ade8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Creating volume 9ed49b1b-0b05-400b-9b03-e2d57ab52dff {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:26 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea853ad-58e4-44e5-9ae2-99beafdcec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa339221-f9d1-4faa-90b0-e58cd8d53364', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:26 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff 1073741824 Sep 03 20:16:26 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a20db88-b20e-4372-92dc-176ace43f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:26 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Volume volume-aa339221-f9d1-4faa-90b0-e58cd8d53364 (aa339221-f9d1-4faa-90b0-e58cd8d53364): created successfully Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a20db88-b20e-4372-92dc-176ace43f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Flow 'volume_create_manager' (ea6446c1-54c7-45d0-ab78-59d021861dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:26 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-da56e929-235c-4099-8a42-8eab88ff6c1a tempest-ProjectReaderTests-1020635530 None] Created volume successfully. Sep 03 20:16:26 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff 1073741824" returned: 0 in 0.470s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:27 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff Sep 03 20:16:27 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:27 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff" returned: 0 in 0.281s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:16:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5de6064-b63d-46dc-9bd2-2a6f3341ed00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f097d55c-bfee-422b-aaa0-1acee9476a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:27 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Volume volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff (9ed49b1b-0b05-400b-9b03-e2d57ab52dff): created successfully Sep 03 20:16:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f097d55c-bfee-422b-aaa0-1acee9476a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Flow 'volume_create_manager' (bc751c3f-18b4-4fa1-9d3c-8bc460c4c35b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:27 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-012550d2-2d33-4579-ae0f-6c52fb7e28b9 tempest-VolumeDependencyTests-2127416422 None] Created volume successfully. Sep 03 20:16:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Acquiring lock "cinder-aa339221-f9d1-4faa-90b0-e58cd8d53364-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Lock "cinder-aa339221-f9d1-4faa-90b0-e58cd8d53364-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Acquiring lock "cinder-quobyte-aa339221-f9d1-4faa-90b0-e58cd8d53364" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Lock "cinder-quobyte-aa339221-f9d1-4faa-90b0-e58cd8d53364" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:27 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfed492f-2de1-4978-ae9b-ffafadab6451]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa339221-f9d1-4faa-90b0-e58cd8d53364 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:27 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa339221-f9d1-4faa-90b0-e58cd8d53364 Sep 03 20:16:27 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:28 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa339221-f9d1-4faa-90b0-e58cd8d53364" returned: 0 in 0.372s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa339221-f9d1-4faa-90b0-e58cd8d53364 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:28 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa339221-f9d1-4faa-90b0-e58cd8d53364 Sep 03 20:16:28 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:28 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa339221-f9d1-4faa-90b0-e58cd8d53364" returned: 0 in 0.334s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Lock "cinder-quobyte-aa339221-f9d1-4faa-90b0-e58cd8d53364" released by "delete_volume" :: held 0.748s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] Creating offline snapshot e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 of volume 9ed49b1b-0b05-400b-9b03-e2d57ab52dff {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce6d6f3-d73b-4cdc-8bd3-8fb2e696a1e9]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Created reservations ['258f5e45-2303-4d5b-97bf-42ce40b7e0f8', 'eaaf90be-e461-4f52-ae1c-f7b98c30b67c', 'd26c2d4b-696a-4301-935e-ea4125901e7c', 'b935c8aa-4bbd-4d2b-b2b8-d4388daa44cc'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:28 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff Sep 03 20:16:28 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:28 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:28 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:28 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff" returned: 0 in 0.429s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:28 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.312s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:28 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:29 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Deleted volume successfully. Sep 03 20:16:29 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 1G Sep 03 20:16:29 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-45707a78-18ff-40ed-accf-8cf4f3ec694a tempest-ProjectReaderTests-1020635530 None] Lock "cinder-aa339221-f9d1-4faa-90b0-e58cd8d53364-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:29 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 1G" returned: 0 in 0.468s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:29 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 Sep 03 20:16:29 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:29 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63" returned: 0 in 0.335s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:29 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 is being set with open permissions: ugo+rw Sep 03 20:16:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:29 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 Sep 03 20:16:29 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:30 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63" returned: 0 in 0.264s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:30 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.info Sep 03 20:16:30 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:30 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.info" returned: 0 in 0.309s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:30 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.info is being set with open permissions: ugo+rw Sep 03 20:16:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:30 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.info Sep 03 20:16:30 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:30 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.info" returned: 0 in 0.322s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.239s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:30 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c7dbbcdc-06a8-46fa-8f84-fef13f59951c tempest-VolumeDependencyTests-2127416422 None] Create snapshot completed successfully Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Flow 'volume_create_manager' (10a1e6b4-afc2-4f47-b07a-f33eef6324ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db17a0c2-dc9f-4561-8249-d44dd19853ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db17a0c2-dc9f-4561-8249-d44dd19853ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-602243034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae78410-84a3-4eed-9beb-515448f719b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3d4a1b959141fb8bc31850f309ecaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e2ed17a0-8e11-4b09-b9de-25ccfb09cc63,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:32Z,use_quota=True,user_id='df49c179fa504e769ada82abef73ade8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0404666c-355c-4701-8c7a-e33c51797ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0404666c-355c-4701-8c7a-e33c51797ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7c845f-78d9-491e-87b5-b2fd06164227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7c845f-78d9-491e-87b5-b2fd06164227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ae78410-84a3-4eed-9beb-515448f719b8', 'volume_name': 'volume-6ae78410-84a3-4eed-9beb-515448f719b8', 'volume_size': 1, 'snapshot_id': 'e2ed17a0-8e11-4b09-b9de-25ccfb09cc63'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08bc4e5a-b287-4ff3-9338-6ace5509de01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08bc4e5a-b287-4ff3-9338-6ace5509de01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160e47f2-f39f-49d8-97a3-b64b134b5f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:32 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Volume 6ae78410-84a3-4eed-9beb-515448f719b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ae78410-84a3-4eed-9beb-515448f719b8', 'volume_size': 1, 'snapshot_id': 'e2ed17a0-8e11-4b09-b9de-25ccfb09cc63'} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "cinder-quobyte-e2ed17a0-8e11-4b09-b9de-25ccfb09cc63-6ae78410-84a3-4eed-9beb-515448f719b8" by "_create_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-quobyte-e2ed17a0-8e11-4b09-b9de-25ccfb09cc63-6ae78410-84a3-4eed-9beb-515448f719b8" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Creating volume 6ae78410-84a3-4eed-9beb-515448f719b8 from snapshot e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 {{(pid=87582) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "cinder-quobyte-6ae78410-84a3-4eed-9beb-515448f719b8" by "_copy_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-quobyte-6ae78410-84a3-4eed-9beb-515448f719b8" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] snapshot: e2ed17a0-8e11-4b09-b9de-25ccfb09cc63, volume: 6ae78410-84a3-4eed-9beb-515448f719b8, {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eec8a6-8a98-4ff8-ba8c-8194261a791e]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:32 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 Sep 03 20:16:32 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:32 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63" returned: 0 in 0.421s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[13628a34-4a44-4d47-87fb-c570dcf707ea]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:33 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff Sep 03 20:16:33 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:33 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff" returned: 0 in 0.404s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Creating direct copy from snapshot {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.utils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Path /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8 not found in is_blk_device check {{(pid=87582) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:33 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8 Sep 03 20:16:33 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Flow 'volume_create_manager' (1ce202b4-454b-4f8f-8b16-8d81516bd4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2297d71a-7062-4ae3-8a59-03dde7bef38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2297d71a-7062-4ae3-8a59-03dde7bef38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1029533931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946cdb6b-c26e-4fe6-814a-f1cab39be143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff175cda1ad44148b59e2f3226a947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:34Z,use_quota=True,user_id='150a278ae3e14c4ead339e06ff1a533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c46889-10f6-4fc0-92bc-c2c4239be2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c46889-10f6-4fc0-92bc-c2c4239be2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed95063-aa42-4efc-970b-d061bb2919f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed95063-aa42-4efc-970b-d061bb2919f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '946cdb6b-c26e-4fe6-814a-f1cab39be143', 'volume_name': 'volume-946cdb6b-c26e-4fe6-814a-f1cab39be143', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e8cd9b-890d-4c17-a7b5-72e1f3bfe01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e8cd9b-890d-4c17-a7b5-72e1f3bfe01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02bb70f7-e925-4067-8a33-0781bac72b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:33 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Volume 946cdb6b-c26e-4fe6-814a-f1cab39be143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-946cdb6b-c26e-4fe6-814a-f1cab39be143', 'volume_size': 1} Sep 03 20:16:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:16:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:36 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:36 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:37 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.575s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:16:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 29 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:16:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:16:38 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8" returned: 0 in 4.899s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff, size 1024.00 MB, duration 4.90 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:16:38 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Converted 1024.00 MB image at 208.97 MB/s Sep 03 20:16:38 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8 is being set with open permissions: ugo+rw Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:38 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8 Sep 03 20:16:38 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:38 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8" returned: 0 in 0.245s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-quobyte-6ae78410-84a3-4eed-9beb-515448f719b8" released by "_copy_volume_from_snapshot" :: held 6.064s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-quobyte-e2ed17a0-8e11-4b09-b9de-25ccfb09cc63-6ae78410-84a3-4eed-9beb-515448f719b8" released by "_create_volume_from_snapshot" :: held 6.137s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.155s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.937s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1029533931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946cdb6b-c26e-4fe6-814a-f1cab39be143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff175cda1ad44148b59e2f3226a947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:34Z,use_quota=True,user_id='150a278ae3e14c4ead339e06ff1a533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Creating volume 946cdb6b-c26e-4fe6-814a-f1cab39be143 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:38 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-946cdb6b-c26e-4fe6-814a-f1cab39be143 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:38 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-946cdb6b-c26e-4fe6-814a-f1cab39be143 1073741824 Sep 03 20:16:38 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160e47f2-f39f-49d8-97a3-b64b134b5f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae78410-84a3-4eed-9beb-515448f719b8', 'volume_size': 1, 'snapshot_id': 'e2ed17a0-8e11-4b09-b9de-25ccfb09cc63'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc9f91b-2835-4439-b31e-2bf9b72b08fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:38 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Volume volume-6ae78410-84a3-4eed-9beb-515448f719b8 (6ae78410-84a3-4eed-9beb-515448f719b8): created successfully Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc9f91b-2835-4439-b31e-2bf9b72b08fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Flow 'volume_create_manager' (10a1e6b4-afc2-4f47-b07a-f33eef6324ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:38 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b122500a-4c0f-4114-881e-adaa8da7b7a5 tempest-VolumeDependencyTests-2127416422 None] Created volume successfully. Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "cinder-e2ed17a0-8e11-4b09-b9de-25ccfb09cc63-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:39 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-e2ed17a0-8e11-4b09-b9de-25ccfb09cc63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "cinder-quobyte-9ed49b1b-0b05-400b-9b03-e2d57ab52dff" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-946cdb6b-c26e-4fe6-814a-f1cab39be143 1073741824" returned: 0 in 0.548s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-quobyte-9ed49b1b-0b05-400b-9b03-e2d57ab52dff" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "cinder-quobyte-e2ed17a0-8e11-4b09-b9de-25ccfb09cc63" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-quobyte-e2ed17a0-8e11-4b09-b9de-25ccfb09cc63" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Deleting offline snapshot e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 of volume 9ed49b1b-0b05-400b-9b03-e2d57ab52dff {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] snapshot_file for this snap is: volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-946cdb6b-c26e-4fe6-814a-f1cab39be143 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc25d1b4-99bb-469f-b419-273171cde503]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:39 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-946cdb6b-c26e-4fe6-814a-f1cab39be143 Sep 03 20:16:39 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:39 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 Sep 03 20:16:39 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:39 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-946cdb6b-c26e-4fe6-814a-f1cab39be143" returned: 0 in 0.280s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02bb70f7-e925-4067-8a33-0781bac72b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946cdb6b-c26e-4fe6-814a-f1cab39be143', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403d1548-7197-4022-afb1-5ac85c0b97f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:39 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Volume volume-946cdb6b-c26e-4fe6-814a-f1cab39be143 (946cdb6b-c26e-4fe6-814a-f1cab39be143): created successfully Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403d1548-7197-4022-afb1-5ac85c0b97f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Flow 'volume_create_manager' (1ce202b4-454b-4f8f-8b16-8d81516bd4ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:39 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e987a609-2bb8-4c33-a56e-43b356878713 tempest-ProjectReaderTests-515585363 None] Created volume successfully. Sep 03 20:16:39 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63" returned: 0 in 0.395s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc7743c-8a7e-47ec-a1d4-8e4f42d7c596]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:39 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff Sep 03 20:16:39 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:40 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff" returned: 0 in 0.555s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:40 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 Sep 03 20:16:40 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:40 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63" returned: 0 in 0.396s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:40 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63 Sep 03 20:16:40 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Acquiring lock "cinder-946cdb6b-c26e-4fe6-814a-f1cab39be143-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Lock "cinder-946cdb6b-c26e-4fe6-814a-f1cab39be143-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Acquiring lock "cinder-quobyte-946cdb6b-c26e-4fe6-814a-f1cab39be143" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Lock "cinder-quobyte-946cdb6b-c26e-4fe6-814a-f1cab39be143" acquired by "delete_volume" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:40 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fb6a20-683f-4fd5-8d61-58bdd88ffe53]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-946cdb6b-c26e-4fe6-814a-f1cab39be143 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:40 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff.e2ed17a0-8e11-4b09-b9de-25ccfb09cc63" returned: 0 in 0.299s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:40 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-946cdb6b-c26e-4fe6-814a-f1cab39be143 Sep 03 20:16:40 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-quobyte-e2ed17a0-8e11-4b09-b9de-25ccfb09cc63" released by "_delete_snapshot" :: held 1.791s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-quobyte-9ed49b1b-0b05-400b-9b03-e2d57ab52dff" released by "delete_snapshot" :: held 1.826s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Created reservations ['63cb9022-2cfd-4469-adef-c309bd1bc9bf', '34889bb5-8a60-4eb5-ac70-d8d5af2f95bf', '0e459295-a505-4d3c-8025-dafcbdf6f0c0', '61ddd705-ec27-4196-9da7-0054057d6630'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:41 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Delete snapshot completed successfully. Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf0dd8ad-39e8-4ff8-9a6e-a65c096187d3 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-e2ed17a0-8e11-4b09-b9de-25ccfb09cc63-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:41 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-946cdb6b-c26e-4fe6-814a-f1cab39be143" returned: 0 in 0.433s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-946cdb6b-c26e-4fe6-814a-f1cab39be143 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "cinder-9ed49b1b-0b05-400b-9b03-e2d57ab52dff-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:41 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-946cdb6b-c26e-4fe6-814a-f1cab39be143 Sep 03 20:16:41 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-9ed49b1b-0b05-400b-9b03-e2d57ab52dff-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "cinder-quobyte-9ed49b1b-0b05-400b-9b03-e2d57ab52dff" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-quobyte-9ed49b1b-0b05-400b-9b03-e2d57ab52dff" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d7da6f-04e5-4110-8937-50a96cb2897c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:41 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-946cdb6b-c26e-4fe6-814a-f1cab39be143" returned: 0 in 0.305s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Lock "cinder-quobyte-946cdb6b-c26e-4fe6-814a-f1cab39be143" released by "delete_volume" :: held 0.781s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:41 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff Sep 03 20:16:41 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Created reservations ['3cdfcac2-31fd-4122-85c9-3d235e0eb1de', '4fe01470-ce30-4be3-99a9-85d60a29e8ca', '103468b4-c758-4ce6-b49b-abe949416820', 'e923c2da-a1ee-43d3-8545-672e22aa55d6'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:41 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:41 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:41 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff" returned: 0 in 0.509s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:42 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff Sep 03 20:16:42 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:42 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.290s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:42 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Deleted volume successfully. Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-691ce5c0-d137-4072-a0d0-c8c639dc51a3 tempest-ProjectReaderTests-515585363 None] Lock "cinder-946cdb6b-c26e-4fe6-814a-f1cab39be143-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:42 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9ed49b1b-0b05-400b-9b03-e2d57ab52dff" returned: 0 in 0.365s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-quobyte-9ed49b1b-0b05-400b-9b03-e2d57ab52dff" released by "delete_volume" :: held 0.961s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Created reservations ['ec2ac9d5-8625-463d-90f7-909d0e9eec50', '89a1f3f9-3d76-4bb3-8978-525b9ab36f45', 'eec71930-e2b9-4f21-b133-89d60dda69c2', 'b5c8fae9-b8c2-44b3-b3fb-5dfce7650b5b'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Flow 'volume_create_manager' (15f4f152-e226-4414-b737-60051b1d7818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e7b8ca-c530-4205-8e75-1193aa6e140d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e7b8ca-c530-4205-8e75-1193aa6e140d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1494513632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b724bfe-2cf0-49c2-b3ff-e6359e34b514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff175cda1ad44148b59e2f3226a947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:42Z,use_quota=True,user_id='150a278ae3e14c4ead339e06ff1a533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08ce666-92e1-4d7d-a619-38b580183d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:42 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:42 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08ce666-92e1-4d7d-a619-38b580183d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a06cd7-d898-41d9-b870-ac063c645f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a06cd7-d898-41d9-b870-ac063c645f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b724bfe-2cf0-49c2-b3ff-e6359e34b514', 'volume_name': 'volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6450b89-aa4c-4ab0-b90b-e593cd8991f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6450b89-aa4c-4ab0-b90b-e593cd8991f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fdaa7d-94ef-49c2-af90-05ab1296f320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:42 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Volume 7b724bfe-2cf0-49c2-b3ff-e6359e34b514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514', 'volume_size': 1} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1494513632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b724bfe-2cf0-49c2-b3ff-e6359e34b514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff175cda1ad44148b59e2f3226a947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:42Z,use_quota=True,user_id='150a278ae3e14c4ead339e06ff1a533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Creating volume 7b724bfe-2cf0-49c2-b3ff-e6359e34b514 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:42 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:42 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514 1073741824 Sep 03 20:16:42 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:42 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.256s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:42 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Deleted volume successfully. Sep 03 20:16:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9f4564c6-4a0e-4066-9b56-0150a3858d04 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-9ed49b1b-0b05-400b-9b03-e2d57ab52dff-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:43 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514 1073741824" returned: 0 in 0.551s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:43 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514 Sep 03 20:16:43 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:43 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514" returned: 0 in 0.277s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fdaa7d-94ef-49c2-af90-05ab1296f320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59f72e5-fa8f-43bf-8e86-d553b277d3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:43 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Volume volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514 (7b724bfe-2cf0-49c2-b3ff-e6359e34b514): created successfully Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59f72e5-fa8f-43bf-8e86-d553b277d3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Flow 'volume_create_manager' (15f4f152-e226-4414-b737-60051b1d7818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:43 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9527e975-c14d-4636-866c-ee45f633dfb8 tempest-ProjectReaderTests-515585363 None] Created volume successfully. Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "cinder-6ae78410-84a3-4eed-9beb-515448f719b8-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-6ae78410-84a3-4eed-9beb-515448f719b8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "cinder-quobyte-6ae78410-84a3-4eed-9beb-515448f719b8" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-quobyte-6ae78410-84a3-4eed-9beb-515448f719b8" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e465c2b1-5c65-494b-a894-2a779c4a2782]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:43 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8 Sep 03 20:16:43 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:44 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8" returned: 0 in 0.384s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:44 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8 Sep 03 20:16:44 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:44 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ae78410-84a3-4eed-9beb-515448f719b8" returned: 0 in 0.293s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-quobyte-6ae78410-84a3-4eed-9beb-515448f719b8" released by "delete_volume" :: held 0.731s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=193,cinder:UPDATE=270,cinder:DELETE=19,cinder:INSERT=58 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=193,cinder:INSERT=67,cinder:UPDATE=226,cinder:DELETE=22 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Created reservations ['82cd46d1-eb98-497a-b9e9-a15e50dcb31f', 'd7156bb4-38f8-4170-a6ca-5f0b2b2c0626', 'dd5ff9d4-541e-4899-8271-de35cc0a5304', '47703d52-f915-4410-8b32-122a25eac186'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:44 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:44 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Acquiring lock "cinder-7b724bfe-2cf0-49c2-b3ff-e6359e34b514-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Lock "cinder-7b724bfe-2cf0-49c2-b3ff-e6359e34b514-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Acquiring lock "cinder-quobyte-7b724bfe-2cf0-49c2-b3ff-e6359e34b514" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Lock "cinder-quobyte-7b724bfe-2cf0-49c2-b3ff-e6359e34b514" acquired by "delete_volume" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fcd61c-6529-40ca-a9e9-4390a5f9f8d2]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:45 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.405s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:45 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:45 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Deleted volume successfully. Sep 03 20:16:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-135e0b49-8223-4d53-a28d-bc1406d2b423 tempest-VolumeDependencyTests-2127416422 None] Lock "cinder-6ae78410-84a3-4eed-9beb-515448f719b8-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:45 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514 Sep 03 20:16:45 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:45 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514" returned: 0 in 0.543s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:45 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514 Sep 03 20:16:45 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:45 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7b724bfe-2cf0-49c2-b3ff-e6359e34b514" returned: 0 in 0.306s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Lock "cinder-quobyte-7b724bfe-2cf0-49c2-b3ff-e6359e34b514" released by "delete_volume" :: held 0.905s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:45 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Created reservations ['7b4b82ff-1a22-42ef-b4e0-98f2beb9a3d8', '2387db5b-d007-42fb-a41c-93e553e1f045', 'cecebb51-5272-43b1-8d32-6c8cea588ca7', '6aa3e3b1-2417-44b7-8b32-7a8566b8b2ec'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:46 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:46 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:46 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.445s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:46 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Deleted volume successfully. Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5cd6d61b-547a-49ad-a421-fcec96b60a6d tempest-ProjectReaderTests-515585363 None] Lock "cinder-7b724bfe-2cf0-49c2-b3ff-e6359e34b514-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Flow 'volume_create_manager' (8719c326-8978-426c-b70b-ef77dc58f37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc090007-71cd-4236-929b-3954bbc31032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc090007-71cd-4236-929b-3954bbc31032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856732553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11f0481-cb2b-4bf3-8ce1-befa18e67239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff175cda1ad44148b59e2f3226a947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:47Z,use_quota=True,user_id='150a278ae3e14c4ead339e06ff1a533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7442db6f-ef21-4d43-8b6a-26b2e7acc0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7442db6f-ef21-4d43-8b6a-26b2e7acc0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c4aceb-0792-4481-a45f-e9bc99fbdfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c4aceb-0792-4481-a45f-e9bc99fbdfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11f0481-cb2b-4bf3-8ce1-befa18e67239', 'volume_name': 'volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad8c963-6c1a-44e2-b01a-a67037a24d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad8c963-6c1a-44e2-b01a-a67037a24d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6d042f-d7ce-482e-b31f-13633ae89623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:46 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Volume c11f0481-cb2b-4bf3-8ce1-befa18e67239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239', 'volume_size': 1} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856732553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11f0481-cb2b-4bf3-8ce1-befa18e67239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff175cda1ad44148b59e2f3226a947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:47Z,use_quota=True,user_id='150a278ae3e14c4ead339e06ff1a533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Creating volume c11f0481-cb2b-4bf3-8ce1-befa18e67239 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:46 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:16:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:46 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239 1073741824 Sep 03 20:16:46 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:47 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239 1073741824" returned: 0 in 0.550s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:47 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239 Sep 03 20:16:47 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:47 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239" returned: 0 in 0.280s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:16:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6d042f-d7ce-482e-b31f-13633ae89623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03117c07-2e07-4e73-8650-047d82299557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:47 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Volume volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239 (c11f0481-cb2b-4bf3-8ce1-befa18e67239): created successfully Sep 03 20:16:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03117c07-2e07-4e73-8650-047d82299557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Flow 'volume_create_manager' (8719c326-8978-426c-b70b-ef77dc58f37f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-28d53676-cacf-4fa2-9189-930871cbbf39 tempest-ProjectReaderTests-515585363 None] Created volume successfully. Sep 03 20:16:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Acquiring lock "cinder-c11f0481-cb2b-4bf3-8ce1-befa18e67239-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Lock "cinder-c11f0481-cb2b-4bf3-8ce1-befa18e67239-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Acquiring lock "cinder-quobyte-c11f0481-cb2b-4bf3-8ce1-befa18e67239" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Lock "cinder-quobyte-c11f0481-cb2b-4bf3-8ce1-befa18e67239" acquired by "delete_volume" :: waited 0.012s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:48 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[723e34d0-d50e-48e9-bb89-47e62f584dc9]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:48 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239 Sep 03 20:16:48 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:49 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239" returned: 0 in 0.377s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:49 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239 Sep 03 20:16:49 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:49 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c11f0481-cb2b-4bf3-8ce1-befa18e67239" returned: 0 in 0.271s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Lock "cinder-quobyte-c11f0481-cb2b-4bf3-8ce1-befa18e67239" released by "delete_volume" :: held 0.690s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:49 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Created reservations ['2b33a5d1-39eb-4677-afd9-613e8a948e96', 'a50a2979-1915-4198-b563-c3700a99efbc', '12bc4c20-9fa6-4503-ac0a-c3bce510340b', 'b65742c6-9719-4cac-b2af-08561a9f000f'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:49 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:49 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:49 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.289s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:49 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:49 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Deleted volume successfully. Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ed2491e9-4e8e-4a17-8b50-d941cd887273 tempest-ProjectReaderTests-515585363 None] Lock "cinder-c11f0481-cb2b-4bf3-8ce1-befa18e67239-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Flow 'volume_create_manager' (e50bd523-80d4-492f-92a9-b2cfd8c19faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114d8bea-3aa9-4b77-b36a-973eaa354b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114d8bea-3aa9-4b77-b36a-973eaa354b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474624243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f887bfc-0c32-4135-8661-b8fe39e5cf37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff175cda1ad44148b59e2f3226a947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:50Z,use_quota=True,user_id='150a278ae3e14c4ead339e06ff1a533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd0e2d1-13e2-43fa-a039-dd70775d3082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd0e2d1-13e2-43fa-a039-dd70775d3082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f004dd-ab44-4480-9097-a99993ee19ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f004dd-ab44-4480-9097-a99993ee19ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f887bfc-0c32-4135-8661-b8fe39e5cf37', 'volume_name': 'volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99bac7d-660c-4dd7-a179-b8923f280dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99bac7d-660c-4dd7-a179-b8923f280dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2677112e-8639-4e18-a193-350c3db90e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:50 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Volume 8f887bfc-0c32-4135-8661-b8fe39e5cf37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37', 'volume_size': 1} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474624243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f887bfc-0c32-4135-8661-b8fe39e5cf37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff175cda1ad44148b59e2f3226a947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:16:50Z,use_quota=True,user_id='150a278ae3e14c4ead339e06ff1a533d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Creating volume 8f887bfc-0c32-4135-8661-b8fe39e5cf37 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:16:50 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:50 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37 1073741824 Sep 03 20:16:50 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:50 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37 1073741824" returned: 0 in 0.439s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:51 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37 Sep 03 20:16:51 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:51 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37" returned: 0 in 0.281s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2677112e-8639-4e18-a193-350c3db90e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084e7a3c-fd00-4d7b-8a23-aa17e34e0d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:16:51 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Volume volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37 (8f887bfc-0c32-4135-8661-b8fe39e5cf37): created successfully Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084e7a3c-fd00-4d7b-8a23-aa17e34e0d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Flow 'volume_create_manager' (e50bd523-80d4-492f-92a9-b2cfd8c19faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:16:51 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e52aa651-2b75-40ff-b8fd-ee5c10d3c7c1 tempest-ProjectReaderTests-515585363 None] Created volume successfully. Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Acquiring lock "cinder-8f887bfc-0c32-4135-8661-b8fe39e5cf37-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Lock "cinder-8f887bfc-0c32-4135-8661-b8fe39e5cf37-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Acquiring lock "cinder-quobyte-8f887bfc-0c32-4135-8661-b8fe39e5cf37" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Lock "cinder-quobyte-8f887bfc-0c32-4135-8661-b8fe39e5cf37" acquired by "delete_volume" :: waited 0.014s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc47c07-0705-44e3-9ee3-23952caa8054]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:51 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37 Sep 03 20:16:51 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:51 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37" returned: 0 in 0.369s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:52 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37 Sep 03 20:16:52 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:52 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-8f887bfc-0c32-4135-8661-b8fe39e5cf37" returned: 0 in 0.277s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Lock "cinder-quobyte-8f887bfc-0c32-4135-8661-b8fe39e5cf37" released by "delete_volume" :: held 0.689s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:16:52 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Created reservations ['13da8b03-19c6-4a63-895c-5515a6805579', '36a28b9b-9833-4820-96c1-ed74c890140e', 'eac54429-3129-4d07-bc2d-7ed11268d48e', 'b78fcc35-da87-4072-8db9-022e84a90427'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:16:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:16:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:16:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:16:52 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:16:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:16:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:16:52 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:16:52 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:16:52 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Sep 03 20:16:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.277s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:16:52 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:16:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Deleted volume successfully. Sep 03 20:16:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7c09b2fd-016b-4931-bd88-9d9c8c13baa8 tempest-ProjectReaderTests-515585363 None] Lock "cinder-8f887bfc-0c32-4135-8661-b8fe39e5cf37-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:17:02 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=20,cinder:INSERT=9,cinder:UPDATE=45,cinder:DELETE=2 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:17:02 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:INSERT=9,cinder:UPDATE=30,cinder:SELECT=24,cinder:DELETE=4 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Flow 'volume_create_manager' (19cfc15f-16ac-47ad-a3de-7f968a259679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534ec7a6-669f-4a35-9f02-3cb52ee57800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534ec7a6-669f-4a35-9f02-3cb52ee57800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1228560370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fda6f1d-9cd7-46fa-b575-52bf44a887f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b55a3be5864d469142bc48bb43cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:17:20Z,use_quota=True,user_id='436d8b9ccc4645d396d6268d6898471b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af25fb2-54c5-48ad-9161-8ad4a9fa7866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af25fb2-54c5-48ad-9161-8ad4a9fa7866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1eb74a9-bf42-4da9-9bdf-c8748878446e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1eb74a9-bf42-4da9-9bdf-c8748878446e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fda6f1d-9cd7-46fa-b575-52bf44a887f6', 'volume_name': 'volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aae1eca-bad5-44d6-8465-175c5b61fe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aae1eca-bad5-44d6-8465-175c5b61fe82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a68557-0505-4de1-b796-08e1325a2adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:20 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Volume 5fda6f1d-9cd7-46fa-b575-52bf44a887f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6', 'volume_size': 1} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1228560370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fda6f1d-9cd7-46fa-b575-52bf44a887f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b55a3be5864d469142bc48bb43cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:17:20Z,use_quota=True,user_id='436d8b9ccc4645d396d6268d6898471b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Creating volume 5fda6f1d-9cd7-46fa-b575-52bf44a887f6 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:17:20 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:20 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 1073741824 Sep 03 20:17:20 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:20 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 1073741824" returned: 0 in 0.428s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:20 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 Sep 03 20:17:20 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:20 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6" returned: 0 in 0.269s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a68557-0505-4de1-b796-08e1325a2adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f3346-d054-4dba-a022-214e2e8adc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:20 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Volume volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 (5fda6f1d-9cd7-46fa-b575-52bf44a887f6): created successfully Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f3346-d054-4dba-a022-214e2e8adc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:20 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Flow 'volume_create_manager' (19cfc15f-16ac-47ad-a3de-7f968a259679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:17:20 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d4d6b470-2e02-416e-af20-4745adf519f1 tempest-SnapshotDependencyTests-246508644 None] Created volume successfully. Sep 03 20:17:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:17:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:17:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] Creating offline snapshot 4ccc7152-4d79-4af3-8365-0240cb05559b of volume 5fda6f1d-9cd7-46fa-b575-52bf44a887f6 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:17:21 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9e693b-bc8a-4756-a00e-40a3bc77bfe2]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:17:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:21 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 Sep 03 20:17:21 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:21 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6" returned: 0 in 0.396s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:21 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b 1G Sep 03 20:17:21 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:22 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b 1G" returned: 0 in 0.375s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:22 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b Sep 03 20:17:22 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:22 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b" returned: 0 in 0.283s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:22 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b is being set with open permissions: ugo+rw Sep 03 20:17:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:22 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b Sep 03 20:17:22 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:22 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b" returned: 0 in 0.248s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:22 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.info Sep 03 20:17:22 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:22 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.info" returned: 0 in 0.246s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:22 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.info is being set with open permissions: ugo+rw Sep 03 20:17:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:22 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.info Sep 03 20:17:22 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:23 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.info" returned: 0 in 0.232s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:17:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-cbec00df-7bb0-4dc2-a8b2-f57d763b1d21 tempest-SnapshotDependencyTests-246508644 None] Create snapshot completed successfully Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Flow 'volume_create_manager' (99dec600-577c-4cd4-a590-6bf7fee5d0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7f3462-6405-4bc5-acf8-445daafbdd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7f3462-6405-4bc5-acf8-445daafbdd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca1bee0-4674-4cd1-ac24-8debaf15ea2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b55a3be5864d469142bc48bb43cc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ccc7152-4d79-4af3-8365-0240cb05559b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:17:24Z,use_quota=True,user_id='436d8b9ccc4645d396d6268d6898471b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6ac920-a7f4-4e5c-a807-8faa35c3bad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6ac920-a7f4-4e5c-a807-8faa35c3bad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a5568c-6e5a-4732-92e2-0420b9a801c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a5568c-6e5a-4732-92e2-0420b9a801c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dca1bee0-4674-4cd1-ac24-8debaf15ea2b', 'volume_name': 'volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b', 'volume_size': 1, 'snapshot_id': '4ccc7152-4d79-4af3-8365-0240cb05559b'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ef4fa0-b837-467a-93e8-c5d3debab762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ef4fa0-b837-467a-93e8-c5d3debab762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35442326-ceb4-4855-b8d9-c95e4e200237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:24 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Volume dca1bee0-4674-4cd1-ac24-8debaf15ea2b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b', 'volume_size': 1, 'snapshot_id': '4ccc7152-4d79-4af3-8365-0240cb05559b'} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "cinder-quobyte-4ccc7152-4d79-4af3-8365-0240cb05559b-dca1bee0-4674-4cd1-ac24-8debaf15ea2b" by "_create_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-quobyte-4ccc7152-4d79-4af3-8365-0240cb05559b-dca1bee0-4674-4cd1-ac24-8debaf15ea2b" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Creating volume dca1bee0-4674-4cd1-ac24-8debaf15ea2b from snapshot 4ccc7152-4d79-4af3-8365-0240cb05559b {{(pid=87582) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "cinder-quobyte-dca1bee0-4674-4cd1-ac24-8debaf15ea2b" by "_copy_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-quobyte-dca1bee0-4674-4cd1-ac24-8debaf15ea2b" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] snapshot: 4ccc7152-4d79-4af3-8365-0240cb05559b, volume: dca1bee0-4674-4cd1-ac24-8debaf15ea2b, {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b186dcc-b05a-486f-a354-44215e897e5b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:24 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b Sep 03 20:17:24 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:24 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b" returned: 0 in 0.353s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c19b2f4-4c2c-485e-9cc6-b7ab1aa67d82]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:24 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 Sep 03 20:17:24 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:24 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6" returned: 0 in 0.362s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Creating direct copy from snapshot {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG cinder.utils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Path /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b not found in is_blk_device check {{(pid=87582) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 20:17:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:24 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b Sep 03 20:17:24 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:28 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b" returned: 0 in 3.774s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:28 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6, size 1024.00 MB, duration 3.78 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:17:28 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Converted 1024.00 MB image at 271.21 MB/s Sep 03 20:17:28 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b is being set with open permissions: ugo+rw Sep 03 20:17:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:28 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b Sep 03 20:17:28 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:28 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b" returned: 0 in 0.240s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-quobyte-dca1bee0-4674-4cd1-ac24-8debaf15ea2b" released by "_copy_volume_from_snapshot" :: held 4.809s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-quobyte-4ccc7152-4d79-4af3-8365-0240cb05559b-dca1bee0-4674-4cd1-ac24-8debaf15ea2b" released by "_create_volume_from_snapshot" :: held 4.872s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.885s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35442326-ceb4-4855-b8d9-c95e4e200237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b', 'volume_size': 1, 'snapshot_id': '4ccc7152-4d79-4af3-8365-0240cb05559b'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92dd9530-62a0-47a9-8a30-fbc6747190ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:29 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Volume volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b (dca1bee0-4674-4cd1-ac24-8debaf15ea2b): created successfully Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92dd9530-62a0-47a9-8a30-fbc6747190ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Flow 'volume_create_manager' (99dec600-577c-4cd4-a590-6bf7fee5d0aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:17:29 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7d3ec4d0-64d7-4e38-8bd0-32fb9d597981 tempest-SnapshotDependencyTests-246508644 None] Created volume successfully. Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "cinder-4ccc7152-4d79-4af3-8365-0240cb05559b-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-4ccc7152-4d79-4af3-8365-0240cb05559b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "cinder-quobyte-5fda6f1d-9cd7-46fa-b575-52bf44a887f6" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-quobyte-5fda6f1d-9cd7-46fa-b575-52bf44a887f6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "cinder-quobyte-4ccc7152-4d79-4af3-8365-0240cb05559b" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-quobyte-4ccc7152-4d79-4af3-8365-0240cb05559b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Deleting offline snapshot 4ccc7152-4d79-4af3-8365-0240cb05559b of volume 5fda6f1d-9cd7-46fa-b575-52bf44a887f6 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] snapshot_file for this snap is: volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eca23cf-ac80-4c5d-939b-b23e647d35b9]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:17:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:29 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b Sep 03 20:17:29 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:30 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b" returned: 0 in 0.354s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:17:30 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff5116b-8478-433e-b03d-3e1db2065e11]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:17:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:30 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 Sep 03 20:17:30 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:30 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6" returned: 0 in 0.534s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:30 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b Sep 03 20:17:30 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:30 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b" returned: 0 in 0.311s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:30 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b Sep 03 20:17:30 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:31 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6.4ccc7152-4d79-4af3-8365-0240cb05559b" returned: 0 in 0.240s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-quobyte-4ccc7152-4d79-4af3-8365-0240cb05559b" released by "_delete_snapshot" :: held 1.531s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:17:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-quobyte-5fda6f1d-9cd7-46fa-b575-52bf44a887f6" released by "delete_snapshot" :: held 1.553s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:17:31 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Created reservations ['ee6f4a71-1e8e-4a5a-97c3-7a5de4ead94a', 'bc54c66e-9d39-48ce-85de-1cacb818c5e8', '37c40925-1922-4ba0-9490-1411be039e97', '6a70531b-9017-4b15-839e-21556ac630fe'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:17:31 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Delete snapshot completed successfully. Sep 03 20:17:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55040ef7-4ae7-4b97-8c6d-a280e310d88c tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-4ccc7152-4d79-4af3-8365-0240cb05559b-delete_snapshot" released by "delete_snapshot" :: held 1.696s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:17:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "cinder-5fda6f1d-9cd7-46fa-b575-52bf44a887f6-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:17:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-5fda6f1d-9cd7-46fa-b575-52bf44a887f6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:17:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "cinder-quobyte-5fda6f1d-9cd7-46fa-b575-52bf44a887f6" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:17:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-quobyte-5fda6f1d-9cd7-46fa-b575-52bf44a887f6" acquired by "delete_volume" :: waited 0.013s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:17:31 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[856f22b8-7886-4393-934b-77221338bcb5]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:17:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:31 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 Sep 03 20:17:31 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:32 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6" returned: 0 in 0.360s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:32 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6 Sep 03 20:17:32 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:32 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5fda6f1d-9cd7-46fa-b575-52bf44a887f6" returned: 0 in 0.248s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-quobyte-5fda6f1d-9cd7-46fa-b575-52bf44a887f6" released by "delete_volume" :: held 0.663s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Created reservations ['61570399-1b14-4c50-aa43-b3241577006e', '7ddb30ca-6e99-4608-9aef-fd829567b882', '94f0398e-954e-438b-986e-19cedaad130d', '5864f68e-eef0-46d7-ba00-ccf9d18d135d'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:32 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:17:32 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:32 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.302s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:17:32 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Deleted volume successfully. Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "cinder-dca1bee0-4674-4cd1-ac24-8debaf15ea2b-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f464f18c-66c9-4d78-b340-d8e8cd7fdb4b tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-5fda6f1d-9cd7-46fa-b575-52bf44a887f6-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:17:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-dca1bee0-4674-4cd1-ac24-8debaf15ea2b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "cinder-quobyte-dca1bee0-4674-4cd1-ac24-8debaf15ea2b" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Flow 'volume_create_manager' (57eb479e-b11f-46a2-9c55-7f6f10f57670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec7678d-1e2b-4949-9727-46edf972dadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-quobyte-dca1bee0-4674-4cd1-ac24-8debaf15ea2b" acquired by "delete_volume" :: waited 0.044s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec7678d-1e2b-4949-9727-46edf972dadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-79987445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b11c9a-b599-440f-907c-584416e99c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d420caa87fa41a7a6fbef071d36be98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:17:33Z,use_quota=True,user_id='0c2695e766fe4f37afbb48f65df1e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09130f6b-c683-4db6-9ddc-ea46395f5f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09130f6b-c683-4db6-9ddc-ea46395f5f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa928886-0a91-4fa2-a455-2f463eb3079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa928886-0a91-4fa2-a455-2f463eb3079f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b11c9a-b599-440f-907c-584416e99c3c', 'volume_name': 'volume-73b11c9a-b599-440f-907c-584416e99c3c', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22531733-458f-4388-aa1c-3941e00cd50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22531733-458f-4388-aa1c-3941e00cd50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1513e0-2b8b-4302-9dc8-2b9943e923c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:33 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Volume 73b11c9a-b599-440f-907c-584416e99c3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b11c9a-b599-440f-907c-584416e99c3c', 'volume_size': 1} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-79987445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b11c9a-b599-440f-907c-584416e99c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d420caa87fa41a7a6fbef071d36be98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:17:33Z,use_quota=True,user_id='0c2695e766fe4f37afbb48f65df1e1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Creating volume 73b11c9a-b599-440f-907c-584416e99c3c {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:17:33 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-73b11c9a-b599-440f-907c-584416e99c3c 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d141eb71-7180-4211-abf1-be6fb1d6f6c7]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:33 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-73b11c9a-b599-440f-907c-584416e99c3c 1073741824 Sep 03 20:17:33 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:33 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b Sep 03 20:17:33 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:33 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b" returned: 0 in 0.378s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:33 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-73b11c9a-b599-440f-907c-584416e99c3c 1073741824" returned: 0 in 0.409s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:33 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b Sep 03 20:17:33 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-73b11c9a-b599-440f-907c-584416e99c3c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:33 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-73b11c9a-b599-440f-907c-584416e99c3c Sep 03 20:17:33 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:33 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dca1bee0-4674-4cd1-ac24-8debaf15ea2b" returned: 0 in 0.258s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-quobyte-dca1bee0-4674-4cd1-ac24-8debaf15ea2b" released by "delete_volume" :: held 0.741s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Created reservations ['ec66b78d-d232-498e-9ec7-20b5ad29ddf9', '14c1c34e-d982-4c1e-a057-025ef4d4924b', '5969ec98-7529-4364-9333-62dcfcf8d2e8', 'ccf6cd9e-6ad0-4364-8ef9-d9fefe4ca421'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:17:33 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-73b11c9a-b599-440f-907c-584416e99c3c" returned: 0 in 0.273s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1513e0-2b8b-4302-9dc8-2b9943e923c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b11c9a-b599-440f-907c-584416e99c3c', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42980966-5f8f-49a6-9ebe-da02b809bba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:17:33 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Volume volume-73b11c9a-b599-440f-907c-584416e99c3c (73b11c9a-b599-440f-907c-584416e99c3c): created successfully Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42980966-5f8f-49a6-9ebe-da02b809bba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:17:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Flow 'volume_create_manager' (57eb479e-b11f-46a2-9c55-7f6f10f57670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:17:33 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-66304d03-e670-4ecd-a79e-7c459e37efcb tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Created volume successfully. Sep 03 20:17:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:17:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:17:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:17:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:17:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:17:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:34 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:17:34 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:34 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.248s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:34 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:17:34 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Deleted volume successfully. Sep 03 20:17:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-267cd7e5-c6ba-4416-b757-60bd177a7a8b tempest-SnapshotDependencyTests-246508644 None] Lock "cinder-dca1bee0-4674-4cd1-ac24-8debaf15ea2b-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:17:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-c912f5f0-40ed-433e-ad50-bc9f9ae3b3d5 req-b865696c-9602-453d-867b-10a5ac5f3194 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:17:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-c912f5f0-40ed-433e-ad50-bc9f9ae3b3d5 req-b865696c-9602-453d-867b-10a5ac5f3194 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:17:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [req-c912f5f0-40ed-433e-ad50-bc9f9ae3b3d5 req-b865696c-9602-453d-867b-10a5ac5f3194 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:17:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-c912f5f0-40ed-433e-ad50-bc9f9ae3b3d5 req-b865696c-9602-453d-867b-10a5ac5f3194 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae', 'name': 'volume-73b11c9a-b599-440f-907c-584416e99c3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58f78965-462a-45c4-b019-fed94fd30fcd', 'enforce_multipath': True} {{(pid=87582) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 20:17:35 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-c912f5f0-40ed-433e-ad50-bc9f9ae3b3d5 req-b865696c-9602-453d-867b-10a5ac5f3194 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] attachment_update completed successfully. Sep 03 20:17:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:17:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:17:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:17:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:17:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:17:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:17:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:36 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:17:36 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:37 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.242s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:17:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:17:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 29 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:17:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:17:38 devstack cinder-volume[87582]: INFO cinder.volume.manager [req-5c0229dd-8512-4f7c-aea5-ae402523d6d9 req-66534904-9376-4c9a-9d2d-5978d39b342c tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Terminate volume connection completed successfully. Sep 03 20:17:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [req-5c0229dd-8512-4f7c-aea5-ae402523d6d9 req-66534904-9376-4c9a-9d2d-5978d39b342c tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Deleting attachment 58f78965-462a-45c4-b019-fed94fd30fcd. {{(pid=87582) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 20:17:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Acquiring lock "cinder-73b11c9a-b599-440f-907c-584416e99c3c-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:17:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Lock "cinder-73b11c9a-b599-440f-907c-584416e99c3c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:17:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Acquiring lock "cinder-quobyte-73b11c9a-b599-440f-907c-584416e99c3c" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:17:39 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Lock "cinder-quobyte-73b11c9a-b599-440f-907c-584416e99c3c" acquired by "delete_volume" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:17:39 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc98f1d6-9831-4728-925f-d896d57b9eb0]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:17:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-73b11c9a-b599-440f-907c-584416e99c3c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:40 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-73b11c9a-b599-440f-907c-584416e99c3c Sep 03 20:17:40 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:40 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-73b11c9a-b599-440f-907c-584416e99c3c" returned: 0 in 0.394s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-73b11c9a-b599-440f-907c-584416e99c3c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:40 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-73b11c9a-b599-440f-907c-584416e99c3c Sep 03 20:17:40 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:40 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-73b11c9a-b599-440f-907c-584416e99c3c" returned: 0 in 0.267s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Lock "cinder-quobyte-73b11c9a-b599-440f-907c-584416e99c3c" released by "delete_volume" :: held 0.706s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:17:40 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Created reservations ['7fd1aea9-0e06-42c3-af30-20e34b4954af', '4a5fc3d0-f90f-4e34-9ff2-072be02636bb', 'fcddb0ab-ffdb-493d-b6e0-d655c9f078ce', 'f6194d9b-a45d-4352-908d-d3c8befe0164'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:17:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:17:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:17:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:17:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:17:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:17:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:17:40 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:17:40 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:17:41 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 03 20:17:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.282s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:17:41 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:17:41 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Deleted volume successfully. Sep 03 20:17:41 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c4d4c4e9-2f42-4ddc-8c32-9bab573b5594 tempest-TestServerVolumeAttachScenarioOldVersion-681285379 None] Lock "cinder-73b11c9a-b599-440f-907c-584416e99c3c-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:17:50 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:UPDATE=45,cinder:INSERT=11,cinder:SELECT=32,cinder:DELETE=3 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:17:51 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=46,cinder:UPDATE=38,cinder:DELETE=4,cinder:INSERT=9 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Flow 'volume_create_manager' (f0c6fa22-67b3-4f0e-ad7b-8866c49e2a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3adebd-a9d3-4ea3-a0e8-78cbb12c5cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3adebd-a9d3-4ea3-a0e8-78cbb12c5cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2109051310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13db4706-a1e3-43bb-ad97-ef6b8fa4c949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6868d0a8c65f4a05a1fdb4637931165d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:18:16Z,use_quota=True,user_id='6a88605b447b42b19f16d09f0b4e6be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c5fd4e-f6cb-4946-9b6b-4525cbb6b880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c5fd4e-f6cb-4946-9b6b-4525cbb6b880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970f66c3-54d8-4003-8447-8f7123e9cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970f66c3-54d8-4003-8447-8f7123e9cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13db4706-a1e3-43bb-ad97-ef6b8fa4c949', 'volume_name': 'volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b7bf02-9a40-443c-b057-480947804d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b7bf02-9a40-443c-b057-480947804d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddb7d3a-8705-4da6-9b25-8db97727a807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:18:16 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Volume 13db4706-a1e3-43bb-ad97-ef6b8fa4c949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949', 'volume_size': 1} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2109051310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13db4706-a1e3-43bb-ad97-ef6b8fa4c949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6868d0a8c65f4a05a1fdb4637931165d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:18:16Z,use_quota=True,user_id='6a88605b447b42b19f16d09f0b4e6be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Creating volume 13db4706-a1e3-43bb-ad97-ef6b8fa4c949 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:18:16 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:18:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:18:16 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 1073741824 Sep 03 20:18:16 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:18:17 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 03 20:18:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 1073741824" returned: 0 in 0.428s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:18:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:18:17 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 Sep 03 20:18:17 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:18:17 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 03 20:18:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949" returned: 0 in 0.240s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:18:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:18:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:18:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddb7d3a-8705-4da6-9b25-8db97727a807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:18:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c344e38b-ffcd-4b46-aeea-079475d23235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:18:17 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Volume volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 (13db4706-a1e3-43bb-ad97-ef6b8fa4c949): created successfully Sep 03 20:18:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c344e38b-ffcd-4b46-aeea-079475d23235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:18:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Flow 'volume_create_manager' (f0c6fa22-67b3-4f0e-ad7b-8866c49e2a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:18:17 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c3aa2089-0a2c-4a01-8d22-df6a4eabc1ef tempest-TestImageHashVerification-1198949265 None] Created volume successfully. Sep 03 20:18:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:18:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:18:18 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b2bc2e-b4f6-4f27-924d-a537807afe39]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:18:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:18:18 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 Sep 03 20:18:18 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:18:18 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 03 20:18:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949" returned: 0 in 0.368s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:18:18 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b2607d-b3e4-481f-b874-168f7873fa0a]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:18:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:18:19 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 Sep 03 20:18:19 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:18:19 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Sep 03 20:18:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949" returned: 0 in 0.358s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:18:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 /opt/stack/data/cinder/conversion/13db4706-a1e3-43bb-ad97-ef6b8fa4c949.temp_image.cbac054f-7937-46f4-ac09-a5abcb15400drt53tzlz.img {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:18:19 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 /opt/stack/data/cinder/conversion/13db4706-a1e3-43bb-ad97-ef6b8fa4c949.temp_image.cbac054f-7937-46f4-ac09-a5abcb15400drt53tzlz.img Sep 03 20:18:19 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:18:23 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 03 20:18:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 /opt/stack/data/cinder/conversion/13db4706-a1e3-43bb-ad97-ef6b8fa4c949.temp_image.cbac054f-7937-46f4-ac09-a5abcb15400drt53tzlz.img" returned: 0 in 4.069s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:18:23 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[86056ee5-e08b-4e7d-805f-4d45bd281058]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:18:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:18:23 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 Sep 03 20:18:23 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:18:23 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 03 20:18:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949" returned: 0 in 0.551s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:18:23 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949, size 1024.00 MB, duration 4.07 sec, destination /opt/stack/data/cinder/conversion/13db4706-a1e3-43bb-ad97-ef6b8fa4c949.temp_image.cbac054f-7937-46f4-ac09-a5abcb15400drt53tzlz.img {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:18:23 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] Converted 1024.00 MB image at 251.54 MB/s Sep 03 20:18:23 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] cbac054f-7937-46f4-ac09-a5abcb15400d was raw, no need to convert to raw {{(pid=87582) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 03 20:18:33 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:18:33 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:UPDATE=4,cinder:SELECT=4,cinder:INSERT=1 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:18:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:18:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:18:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:18:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:18:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:18:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:18:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:18:36 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:18:36 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:18:37 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 03 20:18:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.274s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:18:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:18:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:18:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 29 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:18:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:18:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.129s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:18:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] Uploaded volume to glance image-id: cbac054f-7937-46f4-ac09-a5abcb15400d. {{(pid=87582) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 20:18:42 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-260cd460-d89a-40c1-bd21-48d070629c3d tempest-TestImageHashVerification-1198949265 None] Copy volume to image completed successfully. Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Acquiring lock "cinder-13db4706-a1e3-43bb-ad97-ef6b8fa4c949-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Lock "cinder-13db4706-a1e3-43bb-ad97-ef6b8fa4c949-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Acquiring lock "cinder-quobyte-13db4706-a1e3-43bb-ad97-ef6b8fa4c949" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Lock "cinder-quobyte-13db4706-a1e3-43bb-ad97-ef6b8fa4c949" acquired by "delete_volume" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d163c97-9378-4727-b924-2321d10aff9d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:18:44 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 Sep 03 20:18:44 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:18:44 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949" returned: 0 in 0.394s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:18:44 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949 Sep 03 20:18:44 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:18:44 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-13db4706-a1e3-43bb-ad97-ef6b8fa4c949" returned: 0 in 0.260s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Lock "cinder-quobyte-13db4706-a1e3-43bb-ad97-ef6b8fa4c949" released by "delete_volume" :: held 0.689s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Created reservations ['a0f0b1e6-3515-4122-bbc7-7805c08185c6', '86fed8c1-3cd8-47fe-af31-8b50e6b60de9', 'ffa06581-41d3-45ea-a139-5d580076b51f', '7cc0de14-0dff-4d3c-ab77-0b88b412aa4b'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:18:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:18:44 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:18:44 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:18:45 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 03 20:18:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.274s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:18:45 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:18:45 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Deleted volume successfully. Sep 03 20:18:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5646deb7-b772-4229-97d8-7e49bd7a8558 tempest-TestImageHashVerification-1198949265 None] Lock "cinder-13db4706-a1e3-43bb-ad97-ef6b8fa4c949-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:18:54 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:UPDATE=7,cinder:SELECT=9,cinder:INSERT=2 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:18:55 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=2,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Flow 'volume_create_manager' (a368bc5b-dc1c-475f-9d3d-267eb85f3d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df70445-c281-4ad2-b308-a2644338cfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df70445-c281-4ad2-b308-a2644338cfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bcbfee-6a90-4dab-bff8-da8a35a6fb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99438dfae5248e798ee683bd4d59e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:18:59Z,use_quota=True,user_id='1a03f91de9f8421d93b2324cee9f84f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c00dca9-1cf1-41f8-9e07-49450c67b53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c00dca9-1cf1-41f8-9e07-49450c67b53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544ff80f-b258-4bc4-8f7b-c9b0a87d4b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.image.glance [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Creating Keystone auth plugin from conf {{(pid=87582) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544ff80f-b258-4bc4-8f7b-c9b0a87d4b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '05bcbfee-6a90-4dab-bff8-da8a35a6fb09', 'volume_name': 'volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09', 'volume_size': 1, 'image_id': '3609a148-a0b2-4bef-8d32-51ede952dd29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3609a148-a0b2-4bef-8d32-51ede952dd29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cef464c816011ea8d3009739037b9eaa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c99438dfae5248e798ee683bd4d59e4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db51dce0cad70b3f9456895641ce3c125a9812c41baa7e5fbc53bb6b47bceb92f1dbed2df8af3a697145c037deeed77b48b431da2feb2f0ee460ecfd75ba2a53', 'id': '3609a148-a0b2-4bef-8d32-51ede952dd29', 'created_at': datetime.datetime(2026, 9, 3, 18, 18, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 18, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3609a148-a0b2-4bef-8d32-51ede952dd29/file', 'properties': {}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a993d2f-1246-4af1-b2a8-38c43975da29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a993d2f-1246-4af1-b2a8-38c43975da29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3751811d-b498-407b-a5c4-e0634a677ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:18:59 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Volume 05bcbfee-6a90-4dab-bff8-da8a35a6fb09: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09', 'volume_size': 1, 'image_id': '3609a148-a0b2-4bef-8d32-51ede952dd29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3609a148-a0b2-4bef-8d32-51ede952dd29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cef464c816011ea8d3009739037b9eaa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c99438dfae5248e798ee683bd4d59e4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db51dce0cad70b3f9456895641ce3c125a9812c41baa7e5fbc53bb6b47bceb92f1dbed2df8af3a697145c037deeed77b48b431da2feb2f0ee460ecfd75ba2a53', 'id': '3609a148-a0b2-4bef-8d32-51ede952dd29', 'created_at': datetime.datetime(2026, 9, 3, 18, 18, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 18, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3609a148-a0b2-4bef-8d32-51ede952dd29/file', 'properties': {}}, 'image_service': } Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Trying to clone 05bcbfee-6a90-4dab-bff8-da8a35a6fb09 from image 3609a148-a0b2-4bef-8d32-51ede952dd29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3609a148-a0b2-4bef-8d32-51ede952dd29', 'metadata': {}}]). {{(pid=87582) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 20:18:59 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Image download 0.00 MB at 0.00 MB/s Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9907b673-3531-4ab4-9594-67c986dbf5a0]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:18:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:18:59 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD Sep 03 20:18:59 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:00 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:00 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD Sep 03 20:19:00 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:00 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:19:00 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Temporary image 3609a148-a0b2-4bef-8d32-51ede952dd29 is fetched for user 1a03f91de9f8421d93b2324cee9f84f5. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 20:19:00 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3f4f08-a3f1-48f4-9290-c0064be5c341]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:00 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD Sep 03 20:19:00 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:00 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:00 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD Sep 03 20:19:00 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:01 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD" returned: 1 in 0.312s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bcbfee-6a90-4dab-bff8-da8a35a6fb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99438dfae5248e798ee683bd4d59e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:18:59Z,use_quota=True,user_id='1a03f91de9f8421d93b2324cee9f84f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Creating volume 05bcbfee-6a90-4dab-bff8-da8a35a6fb09 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:01 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:01 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 1073741824 Sep 03 20:19:01 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:01 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 1073741824" returned: 0 in 0.426s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:01 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 Sep 03 20:19:01 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:01 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09" returned: 0 in 0.252s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Attempting download of 3609a148-a0b2-4bef-8d32-51ede952dd29 ((None, [{'url': 'file:///opt/stack/data/glance/images/3609a148-a0b2-4bef-8d32-51ede952dd29', 'metadata': {}}])) to volume 05bcbfee-6a90-4dab-bff8-da8a35a6fb09. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d421a8af-f600-415b-8673-d7920e96a7a3]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3609a148-a0b2-4bef-8d32-51ede952dd29_wab3g5uj {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:02 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3609a148-a0b2-4bef-8d32-51ede952dd29_wab3g5uj Sep 03 20:19:02 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:02 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3609a148-a0b2-4bef-8d32-51ede952dd29_wab3g5uj" returned: 0 in 0.326s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3609a148-a0b2-4bef-8d32-51ede952dd29_wab3g5uj {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:02 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3609a148-a0b2-4bef-8d32-51ede952dd29_wab3g5uj Sep 03 20:19:02 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:02 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3609a148-a0b2-4bef-8d32-51ede952dd29_wab3g5uj" returned: 1 in 0.343s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3609a148-a0b2-4bef-8d32-51ede952dd29_wab3g5uj' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:19:02 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4cecc7-5af1-422e-b83a-9d878f28305d]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:02 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD Sep 03 20:19:02 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:02 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:03 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD Sep 03 20:19:03 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:03 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD" returned: 1 in 0.319s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:19:03 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] 3609a148-a0b2-4bef-8d32-51ede952dd29 was raw, converting to qcow2 {{(pid=87582) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 20:19:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:03 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 Sep 03 20:19:03 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:03 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09" returned: 0 in 0.448s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:03 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3609a148-a0b2-4bef-8d32-51ede952dd29_p7_o_e1tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:19:03 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 20:19:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:03 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 1G Sep 03 20:19:03 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:04 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 1G" returned: 0 in 0.321s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Downloaded image 3609a148-a0b2-4bef-8d32-51ede952dd29 ((None, [{'url': 'file:///opt/stack/data/glance/images/3609a148-a0b2-4bef-8d32-51ede952dd29', 'metadata': {}}])) to volume 05bcbfee-6a90-4dab-bff8-da8a35a6fb09 successfully. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Temporary image 3609a148-a0b2-4bef-8d32-51ede952dd29 for user 1a03f91de9f8421d93b2324cee9f84f5 is deleted. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Marking volume 05bcbfee-6a90-4dab-bff8-da8a35a6fb09 as bootable. {{(pid=87582) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Copying metadata from image 3609a148-a0b2-4bef-8d32-51ede952dd29 to 05bcbfee-6a90-4dab-bff8-da8a35a6fb09. {{(pid=87582) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Creating volume glance metadata for volume 05bcbfee-6a90-4dab-bff8-da8a35a6fb09 backed by image 3609a148-a0b2-4bef-8d32-51ede952dd29 with: {'image_id': '3609a148-a0b2-4bef-8d32-51ede952dd29', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cef464c816011ea8d3009739037b9eaa', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87582) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3751811d-b498-407b-a5c4-e0634a677ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09', 'volume_size': 1, 'image_id': '3609a148-a0b2-4bef-8d32-51ede952dd29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3609a148-a0b2-4bef-8d32-51ede952dd29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cef464c816011ea8d3009739037b9eaa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c99438dfae5248e798ee683bd4d59e4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db51dce0cad70b3f9456895641ce3c125a9812c41baa7e5fbc53bb6b47bceb92f1dbed2df8af3a697145c037deeed77b48b431da2feb2f0ee460ecfd75ba2a53', 'id': '3609a148-a0b2-4bef-8d32-51ede952dd29', 'created_at': datetime.datetime(2026, 9, 3, 18, 18, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 18, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3609a148-a0b2-4bef-8d32-51ede952dd29/file', 'properties': {}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0f9eba-22ed-430b-9314-600787772c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:04 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Volume volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 (05bcbfee-6a90-4dab-bff8-da8a35a6fb09): created successfully Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0f9eba-22ed-430b-9314-600787772c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Flow 'volume_create_manager' (a368bc5b-dc1c-475f-9d3d-267eb85f3d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:04 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-be765d9a-c746-496d-8930-f9d914fd9831 tempest-VolumeImageDependencyTests-380393637 None] Created volume successfully. Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Acquiring lock "cinder-05bcbfee-6a90-4dab-bff8-da8a35a6fb09-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Lock "cinder-05bcbfee-6a90-4dab-bff8-da8a35a6fb09-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Acquiring lock "cinder-quobyte-05bcbfee-6a90-4dab-bff8-da8a35a6fb09" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Lock "cinder-quobyte-05bcbfee-6a90-4dab-bff8-da8a35a6fb09" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9751897-e5d1-4ff5-91de-f0c59ff02a91]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:04 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 Sep 03 20:19:04 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:05 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09" returned: 0 in 0.357s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:05 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09 Sep 03 20:19:05 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:05 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-05bcbfee-6a90-4dab-bff8-da8a35a6fb09" returned: 0 in 0.235s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Lock "cinder-quobyte-05bcbfee-6a90-4dab-bff8-da8a35a6fb09" released by "delete_volume" :: held 0.632s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Created reservations ['5ea70596-b6e4-44c7-9b79-2c372b269f6e', '278c59af-be1c-4e77-ac41-514ead968853', '86958f59-0ec1-4681-b72c-31993fcfa01d', '3de72674-7315-44c4-9efc-099fc0285c3a'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:05 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:05 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:05 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.239s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:05 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Deleted volume successfully. Sep 03 20:19:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d33b7cab-1ba3-4fb6-806a-fd2d4ce6e954 tempest-VolumeImageDependencyTests-380393637 None] Lock "cinder-05bcbfee-6a90-4dab-bff8-da8a35a6fb09-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Flow 'volume_create_manager' (26d150cf-cc4c-4e05-9afd-0616aec9eda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07482c5-6fe3-42d0-9d39-bcad96fec239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07482c5-6fe3-42d0-9d39-bcad96fec239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a180ce9e1e483c829cde8c46b845a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:08Z,use_quota=True,user_id='6646deeb3f3c46e68ae8c0426b92c97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cf31bb-f054-4a09-922e-e50192946c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cf31bb-f054-4a09-922e-e50192946c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5219629f-7d36-42e2-acd4-200c0eac0814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5219629f-7d36-42e2-acd4-200c0eac0814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794', 'volume_name': 'volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc7bf3e-664d-431e-b68c-dedebd983136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc7bf3e-664d-431e-b68c-dedebd983136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71e57ad-41b5-49b7-adcd-c96846cdb0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:08 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Volume 1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794', 'volume_size': 1} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a180ce9e1e483c829cde8c46b845a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:08Z,use_quota=True,user_id='6646deeb3f3c46e68ae8c0426b92c97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Creating volume 1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:08 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:08 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794 1073741824 Sep 03 20:19:08 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:09 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794 1073741824" returned: 0 in 0.395s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:09 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794 Sep 03 20:19:09 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:09 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794" returned: 0 in 0.235s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71e57ad-41b5-49b7-adcd-c96846cdb0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79130c14-fe5d-4f42-9fee-7e452e901fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:09 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Volume volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794 (1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794): created successfully Sep 03 20:19:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79130c14-fe5d-4f42-9fee-7e452e901fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Flow 'volume_create_manager' (26d150cf-cc4c-4e05-9afd-0616aec9eda5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:09 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b31be313-315c-4c34-8174-23054cebd455 tempest-CinderUnicodeTest-658816004 None] Created volume successfully. Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Flow 'volume_create_manager' (b1a8c475-d3cf-4da4-9fc4-a4c69e4c6d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df9d406-1c26-4216-829e-c4832e2001bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df9d406-1c26-4216-829e-c4832e2001bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1320527093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc38dabd-05a9-4a90-a7aa-51cf383a76bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a180ce9e1e483c829cde8c46b845a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:10Z,use_quota=True,user_id='6646deeb3f3c46e68ae8c0426b92c97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7bd163-60b3-4570-bb26-f5cb68c6ea3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7bd163-60b3-4570-bb26-f5cb68c6ea3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c9eaea-3598-464b-8f0b-49e3bff10409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c9eaea-3598-464b-8f0b-49e3bff10409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc38dabd-05a9-4a90-a7aa-51cf383a76bb', 'volume_name': 'volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d857b1d5-3d9b-4788-957e-e36e8d6d58b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d857b1d5-3d9b-4788-957e-e36e8d6d58b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253ffc4a-80a5-47f4-9acb-710fd74d8174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:10 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Volume dc38dabd-05a9-4a90-a7aa-51cf383a76bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb', 'volume_size': 1} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1320527093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc38dabd-05a9-4a90-a7aa-51cf383a76bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a180ce9e1e483c829cde8c46b845a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:10Z,use_quota=True,user_id='6646deeb3f3c46e68ae8c0426b92c97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Creating volume dc38dabd-05a9-4a90-a7aa-51cf383a76bb {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:10 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:10 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb 1073741824 Sep 03 20:19:10 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:10 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb 1073741824" returned: 0 in 0.399s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:10 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb Sep 03 20:19:10 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:10 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb" returned: 0 in 0.241s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253ffc4a-80a5-47f4-9acb-710fd74d8174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd966b5-1a97-41a9-84ad-2b26571b7e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:10 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Volume volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb (dc38dabd-05a9-4a90-a7aa-51cf383a76bb): created successfully Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd966b5-1a97-41a9-84ad-2b26571b7e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Flow 'volume_create_manager' (b1a8c475-d3cf-4da4-9fc4-a4c69e4c6d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:10 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f3e71a59-6e4d-4175-96a4-c9c996d5e1cc tempest-CinderUnicodeTest-658816004 None] Created volume successfully. Sep 03 20:19:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] Creating offline snapshot 8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 of volume dc38dabd-05a9-4a90-a7aa-51cf383a76bb {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:19:11 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb205cb0-285a-480a-9d14-04f4962945bc]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:11 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb Sep 03 20:19:11 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:11 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb" returned: 0 in 0.357s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:11 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 1G Sep 03 20:19:11 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:12 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 1G" returned: 0 in 0.383s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:12 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 Sep 03 20:19:12 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:12 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3" returned: 0 in 0.311s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:12 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 is being set with open permissions: ugo+rw Sep 03 20:19:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:12 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 Sep 03 20:19:12 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:12 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3" returned: 0 in 0.244s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:12 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.info Sep 03 20:19:12 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:12 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.info" returned: 0 in 0.271s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:12 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.info is being set with open permissions: ugo+rw Sep 03 20:19:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:12 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.info Sep 03 20:19:12 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:13 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.info" returned: 0 in 0.245s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:13 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ceb10893-4264-4c58-8072-f9c1f7a2d64d tempest-CinderUnicodeTest-658816004 None] Create snapshot completed successfully Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Acquiring lock "cinder-8ffeeafb-e9e2-41c0-a884-ae74fcd392c3-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Lock "cinder-8ffeeafb-e9e2-41c0-a884-ae74fcd392c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Acquiring lock "cinder-quobyte-dc38dabd-05a9-4a90-a7aa-51cf383a76bb" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Lock "cinder-quobyte-dc38dabd-05a9-4a90-a7aa-51cf383a76bb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Acquiring lock "cinder-quobyte-8ffeeafb-e9e2-41c0-a884-ae74fcd392c3" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Lock "cinder-quobyte-8ffeeafb-e9e2-41c0-a884-ae74fcd392c3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Deleting offline snapshot 8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 of volume dc38dabd-05a9-4a90-a7aa-51cf383a76bb {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] snapshot_file for this snap is: volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c945a2df-5e34-4d7c-83fb-6dd60a3a269d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:13 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 Sep 03 20:19:13 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:13 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3" returned: 0 in 0.363s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a48660-e17b-4b16-9da4-a2c58adbb6df]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:13 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb Sep 03 20:19:13 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:14 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb" returned: 0 in 0.345s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:14 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 Sep 03 20:19:14 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:14 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3" returned: 0 in 0.327s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:14 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3 Sep 03 20:19:14 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:14 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb.8ffeeafb-e9e2-41c0-a884-ae74fcd392c3" returned: 0 in 0.235s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Lock "cinder-quobyte-8ffeeafb-e9e2-41c0-a884-ae74fcd392c3" released by "_delete_snapshot" :: held 1.362s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Lock "cinder-quobyte-dc38dabd-05a9-4a90-a7aa-51cf383a76bb" released by "delete_snapshot" :: held 1.383s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:14 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Created reservations ['5dced304-0336-4ffe-ba48-df6fa9aa6277', 'a265efef-113a-4ab2-bff7-9bd13526a071', 'ca24ff22-8e7a-4dd8-8dc2-5b97781988bd', '1d8a3d6c-336a-4639-bcf3-64f2dc7a0fe4'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:14 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Delete snapshot completed successfully. Sep 03 20:19:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d7dbb730-d2bb-46a6-9ead-d5875895c736 tempest-CinderUnicodeTest-658816004 None] Lock "cinder-8ffeeafb-e9e2-41c0-a884-ae74fcd392c3-delete_snapshot" released by "delete_snapshot" :: held 1.504s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Acquiring lock "cinder-dc38dabd-05a9-4a90-a7aa-51cf383a76bb-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Lock "cinder-dc38dabd-05a9-4a90-a7aa-51cf383a76bb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Acquiring lock "cinder-quobyte-dc38dabd-05a9-4a90-a7aa-51cf383a76bb" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Lock "cinder-quobyte-dc38dabd-05a9-4a90-a7aa-51cf383a76bb" acquired by "delete_volume" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:15 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75f5234-c391-4d75-bf94-a5ff5e3bf844]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:15 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb Sep 03 20:19:15 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:16 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb" returned: 0 in 0.359s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:16 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb Sep 03 20:19:16 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:16 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-dc38dabd-05a9-4a90-a7aa-51cf383a76bb" returned: 0 in 0.254s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Lock "cinder-quobyte-dc38dabd-05a9-4a90-a7aa-51cf383a76bb" released by "delete_volume" :: held 0.667s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Created reservations ['1a89f547-4e8a-4365-9dff-638d0b4c46ee', 'e92d617c-a62f-4732-abfe-b8a917ceb86b', '117db38e-826f-42c0-b624-c5d0c5f46981', '9cd6cdc1-8470-42d4-aace-16ec8a598767'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:16 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:16 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:16 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.243s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:16 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Deleted volume successfully. Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-db1ee692-e74a-4b30-8e49-57a086e08a0a tempest-CinderUnicodeTest-658816004 None] Lock "cinder-dc38dabd-05a9-4a90-a7aa-51cf383a76bb-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Acquiring lock "cinder-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Lock "cinder-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Acquiring lock "cinder-quobyte-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Lock "cinder-quobyte-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794" acquired by "delete_volume" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc54f84c-062e-4503-9b5a-d37e05226398]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:17 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794 Sep 03 20:19:17 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:17 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794" returned: 0 in 0.354s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:17 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794 Sep 03 20:19:17 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:17 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794" returned: 0 in 0.236s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Lock "cinder-quobyte-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794" released by "delete_volume" :: held 0.627s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Created reservations ['a93d3e08-8aba-40e1-86e2-cc8bd22da019', '05f9130f-ed96-4ed1-b8a5-dd94b9decb34', 'ef59c642-535b-428b-8a0b-26f7b86f4508', 'a06f75b2-464d-4ed8-8e3b-6e82a0d44d45'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:17 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:17 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:18 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.247s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:18 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:18 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Deleted volume successfully. Sep 03 20:19:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fcde141d-8510-4aee-9b1e-350e2d89ab35 tempest-CinderUnicodeTest-658816004 None] Lock "cinder-1a0a97cd-9f6f-4b2d-bb1b-ce53cd3ee794-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:27 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=35,cinder:UPDATE=39,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:19:28 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=36,cinder:UPDATE=44,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Flow 'volume_create_manager' (a62e7ef7-844d-4bc4-94c3-44f189d7d900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5e893e-1eec-4576-a11d-62e444a291db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5e893e-1eec-4576-a11d-62e444a291db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-188095772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe5f03f-c79a-4e79-809d-1e6ef97c89cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e5f87bc3614505ae3e9e51108738ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:34Z,use_quota=True,user_id='2c1d3f1c85964a05947b16383efe1e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1b5164-698a-4223-86cb-56726ef6e68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1b5164-698a-4223-86cb-56726ef6e68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ddf809-291a-4917-a337-b851231716c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ddf809-291a-4917-a337-b851231716c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe5f03f-c79a-4e79-809d-1e6ef97c89cb', 'volume_name': 'volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f114c2e3-49cc-4657-8375-86979ef65c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f114c2e3-49cc-4657-8375-86979ef65c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c92c74-f31d-477f-a884-1eaa7ad29ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:33 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Volume cfe5f03f-c79a-4e79-809d-1e6ef97c89cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb', 'volume_size': 1} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-188095772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe5f03f-c79a-4e79-809d-1e6ef97c89cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e5f87bc3614505ae3e9e51108738ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:34Z,use_quota=True,user_id='2c1d3f1c85964a05947b16383efe1e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Creating volume cfe5f03f-c79a-4e79-809d-1e6ef97c89cb {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:33 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:33 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb 1073741824 Sep 03 20:19:33 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Flow 'volume_create_manager' (f994014a-1a59-4187-ae58-dc068db03e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e61ae26-7c4b-4479-8852-92ddcdecda52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e61ae26-7c4b-4479-8852-92ddcdecda52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1758930906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8cf95a-40fa-48ea-ae19-31cd14b28513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236c9573150c44ec82979d359d03d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:34Z,use_quota=True,user_id='1e9b39dd75d74adda0f2f1b3facf4a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0380fae4-8ecc-43c4-b943-cbee70dc864d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0380fae4-8ecc-43c4-b943-cbee70dc864d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5652138-6224-4783-b915-977ed0ba2257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5652138-6224-4783-b915-977ed0ba2257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed8cf95a-40fa-48ea-ae19-31cd14b28513', 'volume_name': 'volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9b4fd7-eddc-4cd6-a82c-b2395c97985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9b4fd7-eddc-4cd6-a82c-b2395c97985f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2da76cc-21c5-4d52-9011-1915d467c199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:34 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume ed8cf95a-40fa-48ea-ae19-31cd14b28513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513', 'volume_size': 1} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Flow 'volume_create_manager' (da999a8a-8919-4b69-9bcd-e018f30678b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f17315-ede5-4dc5-940e-37b00bc7a995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:34 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb 1073741824" returned: 0 in 0.770s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f17315-ede5-4dc5-940e-37b00bc7a995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-767279773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80ad292-3eac-464f-b001-eebcdfb561de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e5f87bc3614505ae3e9e51108738ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:34Z,use_quota=True,user_id='2c1d3f1c85964a05947b16383efe1e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e25fb6-5d7a-4d02-8b79-9b2daf89afdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e25fb6-5d7a-4d02-8b79-9b2daf89afdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f83679-fa78-4ce8-aa52-be7c81b82b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f83679-fa78-4ce8-aa52-be7c81b82b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c80ad292-3eac-464f-b001-eebcdfb561de', 'volume_name': 'volume-c80ad292-3eac-464f-b001-eebcdfb561de', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c989af60-236c-4e9b-8fe4-cb6220321cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c989af60-236c-4e9b-8fe4-cb6220321cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95080be5-9469-4bc4-bc00-d248b6abb998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:34 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Volume c80ad292-3eac-464f-b001-eebcdfb561de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c80ad292-3eac-464f-b001-eebcdfb561de', 'volume_size': 1} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:34 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb Sep 03 20:19:34 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Flow 'volume_create_manager' (9df5b3c5-e1db-410c-aeb9-be740aed4943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8701d61-23ae-4f31-a9ef-85af76cc65ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:35 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb" returned: 0 in 0.399s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.999s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1758930906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8cf95a-40fa-48ea-ae19-31cd14b28513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236c9573150c44ec82979d359d03d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:34Z,use_quota=True,user_id='1e9b39dd75d74adda0f2f1b3facf4a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Creating volume ed8cf95a-40fa-48ea-ae19-31cd14b28513 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:35 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8701d61-23ae-4f31-a9ef-85af76cc65ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-750607323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb304456-cd5a-4d8a-b5d8-4456b84fb084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e5f87bc3614505ae3e9e51108738ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:35Z,use_quota=True,user_id='2c1d3f1c85964a05947b16383efe1e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888a18b0-a6fa-4123-a4fe-6a0e182d0a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888a18b0-a6fa-4123-a4fe-6a0e182d0a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:35 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 1073741824 Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52d70b4-5bb6-4a5c-9892-4478916ad376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:35 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52d70b4-5bb6-4a5c-9892-4478916ad376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb304456-cd5a-4d8a-b5d8-4456b84fb084', 'volume_name': 'volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98669523-0f91-49a3-ad53-4091e82194da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98669523-0f91-49a3-ad53-4091e82194da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8d3a36-5bc7-4d6f-b77e-85e0708fb824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:35 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Volume fb304456-cd5a-4d8a-b5d8-4456b84fb084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084', 'volume_size': 1} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c92c74-f31d-477f-a884-1eaa7ad29ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77375b1e-73d3-4821-86f1-938fcb17a3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:35 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Volume volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb (cfe5f03f-c79a-4e79-809d-1e6ef97c89cb): created successfully Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77375b1e-73d3-4821-86f1-938fcb17a3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Flow 'volume_create_manager' (a62e7ef7-844d-4bc4-94c3-44f189d7d900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:35 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-99ebb33e-f6a0-43ef-afde-0aacf7e2e584 tempest-CreateVolumesFromImageTest-1820553801 None] Created volume successfully. Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Flow 'volume_create_manager' (fff28d1f-06f2-4f60-887f-b85ecc928efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c754812e-3c2c-4a5d-95a3-220f1e0b8506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c754812e-3c2c-4a5d-95a3-220f1e0b8506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1567826500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5c4e2a-0960-44c6-adec-8cae9a3631c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e5f87bc3614505ae3e9e51108738ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:36Z,use_quota=True,user_id='2c1d3f1c85964a05947b16383efe1e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0dabd4-7928-4ee1-af25-3033c3e514ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0dabd4-7928-4ee1-af25-3033c3e514ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92278c87-201a-425c-a745-8d60a2d503d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92278c87-201a-425c-a745-8d60a2d503d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5c4e2a-0960-44c6-adec-8cae9a3631c0', 'volume_name': 'volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45fe6108-2288-4e39-af97-c44e1d88520e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45fe6108-2288-4e39-af97-c44e1d88520e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566a8942-255b-4b29-a417-a436fa5e9107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:35 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Volume ff5c4e2a-0960-44c6-adec-8cae9a3631c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0', 'volume_size': 1} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:35 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 1073741824" returned: 0 in 0.705s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:35 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 Sep 03 20:19:35 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:36 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513" returned: 0 in 0.308s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.526s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-767279773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80ad292-3eac-464f-b001-eebcdfb561de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e5f87bc3614505ae3e9e51108738ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:34Z,use_quota=True,user_id='2c1d3f1c85964a05947b16383efe1e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Creating volume c80ad292-3eac-464f-b001-eebcdfb561de {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:36 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c80ad292-3eac-464f-b001-eebcdfb561de 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:36 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c80ad292-3eac-464f-b001-eebcdfb561de 1073741824 Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2da76cc-21c5-4d52-9011-1915d467c199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:36 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86069003-6db3-4422-933d-8be0f30d2367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:36 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 (ed8cf95a-40fa-48ea-ae19-31cd14b28513): created successfully Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86069003-6db3-4422-933d-8be0f30d2367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Flow 'volume_create_manager' (f994014a-1a59-4187-ae58-dc068db03e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Flow 'volume_create_manager' (60169aec-0efb-45a6-b2dd-09f8fc86ba3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2296c60-a891-4267-b288-7dd6d90b6ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:36 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8204ea29-6baa-4973-9641-d06aa3af14a3 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Created volume successfully. Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2296c60-a891-4267-b288-7dd6d90b6ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1113275093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9cc836d-9284-4a91-9b2f-aeab31e6220e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e5f87bc3614505ae3e9e51108738ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:36Z,use_quota=True,user_id='2c1d3f1c85964a05947b16383efe1e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea843ddd-06f3-4e91-a684-cf7d31d3908b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea843ddd-06f3-4e91-a684-cf7d31d3908b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c466d9-eac6-4b52-9db6-0e30cca5e0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c466d9-eac6-4b52-9db6-0e30cca5e0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9cc836d-9284-4a91-9b2f-aeab31e6220e', 'volume_name': 'volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281f440a-e73c-4cba-a6e4-2692678003a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281f440a-e73c-4cba-a6e4-2692678003a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead009da-e377-4fb3-9aa0-46c1c1c3cf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:36 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Volume f9cc836d-9284-4a91-9b2f-aeab31e6220e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e', 'volume_size': 1} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:36 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:36 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:36 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c80ad292-3eac-464f-b001-eebcdfb561de 1073741824" returned: 0 in 0.545s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c80ad292-3eac-464f-b001-eebcdfb561de {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:36 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c80ad292-3eac-464f-b001-eebcdfb561de Sep 03 20:19:36 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:37 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.306s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 29 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:19:37 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c80ad292-3eac-464f-b001-eebcdfb561de" returned: 0 in 0.285s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.896s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-750607323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb304456-cd5a-4d8a-b5d8-4456b84fb084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e5f87bc3614505ae3e9e51108738ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:35Z,use_quota=True,user_id='2c1d3f1c85964a05947b16383efe1e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Creating volume fb304456-cd5a-4d8a-b5d8-4456b84fb084 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:37 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:37 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084 1073741824 Sep 03 20:19:37 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95080be5-9469-4bc4-bc00-d248b6abb998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c80ad292-3eac-464f-b001-eebcdfb561de', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4ad6dc-3933-4ead-a817-c9b4dad2effb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:37 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Volume volume-c80ad292-3eac-464f-b001-eebcdfb561de (c80ad292-3eac-464f-b001-eebcdfb561de): created successfully Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4ad6dc-3933-4ead-a817-c9b4dad2effb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Flow 'volume_create_manager' (da999a8a-8919-4b69-9bcd-e018f30678b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:37 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-cca324ab-4e06-4c50-b230-6b6e890c29e4 tempest-CreateVolumesFromImageTest-1820553801 None] Created volume successfully. Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:37 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084 1073741824" returned: 0 in 0.622s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Flow 'volume_create_manager' (42daedab-2e90-4d70-9049-3e62af872d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503a8f8f-7f6e-4963-909a-0796c124065f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503a8f8f-7f6e-4963-909a-0796c124065f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd959370-1ac9-470e-9316-60d4628a9a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a51f815d9224facaef8773abea55e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:38Z,use_quota=True,user_id='20cb0b5f68b24dfeb5804925e2fd0373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5da02f0-e833-47c8-831c-97f005cbe7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5da02f0-e833-47c8-831c-97f005cbe7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2080e20e-b203-48c2-bbbf-3368ba0eadb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG cinder.image.glance [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Creating Keystone auth plugin from conf {{(pid=87582) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 20:19:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:37 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084 Sep 03 20:19:37 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2080e20e-b203-48c2-bbbf-3368ba0eadb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd959370-1ac9-470e-9316-60d4628a9a15', 'volume_name': 'volume-cd959370-1ac9-470e-9316-60d4628a9a15', 'volume_size': 1, 'image_id': '7beeb06b-6ab3-4c48-8328-cf0acc99d2b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7beeb06b-6ab3-4c48-8328-cf0acc99d2b4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c0cf87ba209927ea618538e3859fcff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3a51f815d9224facaef8773abea55e0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1fefad721ffa56c164ab1dc83d9fee22a6b6a6233afdbb1609c6c47a8b0fb13ee013f6ea3562e5de2681b490b3e5ff77d2917821936975beb9084f84a993d4f9', 'id': '7beeb06b-6ab3-4c48-8328-cf0acc99d2b4', 'created_at': datetime.datetime(2026, 9, 3, 18, 19, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 19, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7beeb06b-6ab3-4c48-8328-cf0acc99d2b4/file', 'properties': {}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3367c52c-0e56-4c2f-a76d-9fc301a27a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3367c52c-0e56-4c2f-a76d-9fc301a27a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493ffc98-81fc-4436-abc2-15a524ce0f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:38 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Volume cd959370-1ac9-470e-9316-60d4628a9a15: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd959370-1ac9-470e-9316-60d4628a9a15', 'volume_size': 1, 'image_id': '7beeb06b-6ab3-4c48-8328-cf0acc99d2b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7beeb06b-6ab3-4c48-8328-cf0acc99d2b4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c0cf87ba209927ea618538e3859fcff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3a51f815d9224facaef8773abea55e0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1fefad721ffa56c164ab1dc83d9fee22a6b6a6233afdbb1609c6c47a8b0fb13ee013f6ea3562e5de2681b490b3e5ff77d2917821936975beb9084f84a993d4f9', 'id': '7beeb06b-6ab3-4c48-8328-cf0acc99d2b4', 'created_at': datetime.datetime(2026, 9, 3, 18, 19, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 19, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7beeb06b-6ab3-4c48-8328-cf0acc99d2b4/file', 'properties': {}}, 'image_service': } Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Trying to clone cd959370-1ac9-470e-9316-60d4628a9a15 from image 7beeb06b-6ab3-4c48-8328-cf0acc99d2b4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7beeb06b-6ab3-4c48-8328-cf0acc99d2b4', 'metadata': {}}]). {{(pid=87582) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 20:19:38 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084" returned: 0 in 0.282s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.342s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1567826500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5c4e2a-0960-44c6-adec-8cae9a3631c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e5f87bc3614505ae3e9e51108738ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:36Z,use_quota=True,user_id='2c1d3f1c85964a05947b16383efe1e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Creating volume ff5c4e2a-0960-44c6-adec-8cae9a3631c0 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:38 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8d3a36-5bc7-4d6f-b77e-85e0708fb824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:38 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0 1073741824 Sep 03 20:19:38 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1486213e-62ad-4abf-9ccc-742c1c73a722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:38 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Volume volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084 (fb304456-cd5a-4d8a-b5d8-4456b84fb084): created successfully Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1486213e-62ad-4abf-9ccc-742c1c73a722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Flow 'volume_create_manager' (9df5b3c5-e1db-410c-aeb9-be740aed4943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:38 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-283882c8-1f11-4e4b-9955-4b6b64cd075a tempest-CreateVolumesFromImageTest-1820553801 None] Created volume successfully. Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 20:19:38 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Image download 0.00 MB at 0.00 MB/s Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3306e7df-104d-4757-8820-dd99f3e53be7]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:38 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD Sep 03 20:19:38 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:38 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0 1073741824" returned: 0 in 0.613s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:38 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:38 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0 Sep 03 20:19:38 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Flow 'volume_create_manager' (c4fa2f32-b0de-41cd-8416-21ecdff69b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995ce73f-14f1-42ae-b4a8-20cb56bab6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995ce73f-14f1-42ae-b4a8-20cb56bab6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bdfeda-e62c-4b9b-9cac-75babb145d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3bbb39c45f04d7db779c8226f4d94b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:39Z,use_quota=True,user_id='6b1dde4562334f10ac27b231cbdf3bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36387e55-cf38-433a-8e52-07a6cb48885d),volume_type_id=36387e55-cf38-433a-8e52-07a6cb48885d)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b91bb5e-52b7-4bcb-b028-a247d4225edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b91bb5e-52b7-4bcb-b028-a247d4225edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4831230a-f8f5-42ac-bf90-bfeca2c3732d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.image.glance [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Creating Keystone auth plugin from conf {{(pid=87582) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 20:19:39 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD Sep 03 20:19:39 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:39 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0" returned: 0 in 0.264s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.714s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1113275093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9cc836d-9284-4a91-9b2f-aeab31e6220e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e5f87bc3614505ae3e9e51108738ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:36Z,use_quota=True,user_id='2c1d3f1c85964a05947b16383efe1e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Creating volume f9cc836d-9284-4a91-9b2f-aeab31e6220e {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:39 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:39 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e 1073741824 Sep 03 20:19:39 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566a8942-255b-4b29-a417-a436fa5e9107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fe679a-c9c6-49cd-8a7d-9241770df6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:39 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Volume volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0 (ff5c4e2a-0960-44c6-adec-8cae9a3631c0): created successfully Sep 03 20:19:39 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fe679a-c9c6-49cd-8a7d-9241770df6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Flow 'volume_create_manager' (fff28d1f-06f2-4f60-887f-b85ecc928efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4831230a-f8f5-42ac-bf90-bfeca2c3732d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '68bdfeda-e62c-4b9b-9cac-75babb145d47', 'volume_name': 'volume-68bdfeda-e62c-4b9b-9cac-75babb145d47', 'volume_size': 1, 'image_id': 'cf6ab9e3-80f7-4bcc-95ad-297c0743e113', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6ab9e3-80f7-4bcc-95ad-297c0743e113', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dead2d61d38f6ddbed9bfb61e7e506ed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3bbb39c45f04d7db779c8226f4d94b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31b9c3fce6c818e9fff4bed909497a1aa4559981c3ff5fd63ba543d7984a34a9335635241be73065d0e69e26ebe39b30d485f0049a4c167a86ccf6782f07c3fc', 'id': 'cf6ab9e3-80f7-4bcc-95ad-297c0743e113', 'created_at': datetime.datetime(2026, 9, 3, 18, 19, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 19, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6ab9e3-80f7-4bcc-95ad-297c0743e113/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6282baaa-6d57-4ba8-a780-dd81a8df97da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6282baaa-6d57-4ba8-a780-dd81a8df97da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9268e14e-bddb-4e67-a5cd-a7234c854ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:39 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Volume 68bdfeda-e62c-4b9b-9cac-75babb145d47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-68bdfeda-e62c-4b9b-9cac-75babb145d47', 'volume_size': 1, 'image_id': 'cf6ab9e3-80f7-4bcc-95ad-297c0743e113', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6ab9e3-80f7-4bcc-95ad-297c0743e113', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dead2d61d38f6ddbed9bfb61e7e506ed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3bbb39c45f04d7db779c8226f4d94b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31b9c3fce6c818e9fff4bed909497a1aa4559981c3ff5fd63ba543d7984a34a9335635241be73065d0e69e26ebe39b30d485f0049a4c167a86ccf6782f07c3fc', 'id': 'cf6ab9e3-80f7-4bcc-95ad-297c0743e113', 'created_at': datetime.datetime(2026, 9, 3, 18, 19, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 19, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6ab9e3-80f7-4bcc-95ad-297c0743e113/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Trying to clone 68bdfeda-e62c-4b9b-9cac-75babb145d47 from image cf6ab9e3-80f7-4bcc-95ad-297c0743e113 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf6ab9e3-80f7-4bcc-95ad-297c0743e113', 'metadata': {}}]). {{(pid=87582) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Temporary image 7beeb06b-6ab3-4c48-8328-cf0acc99d2b4 is fetched for user 20cb0b5f68b24dfeb5804925e2fd0373. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 20:19:39 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-77f4e62c-d053-41ef-8312-6eb2afb732c2 tempest-CreateVolumesFromImageTest-1820553801 None] Created volume successfully. Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[053c8cdb-47b2-4e29-bc34-73b0b1982f6f]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 20:19:39 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Image download 0.00 MB at 0.00 MB/s Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6d2ddb-430d-474f-8279-7a16c68e2b52]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:39 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD Sep 03 20:19:39 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:39 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD Sep 03 20:19:39 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:39 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e 1073741824" returned: 0 in 0.536s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:39 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:39 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e Sep 03 20:19:39 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:39 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:39 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD Sep 03 20:19:39 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:40 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD Sep 03 20:19:40 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:40 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e" returned: 0 in 0.283s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.453s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead009da-e377-4fb3-9aa0-46c1c1c3cf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887e96ae-1f43-4bfd-a8d9-8927d4bed9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] Creating offline snapshot ac94b346-077d-4fe6-ad9c-a2e64da1fa66 of volume ed8cf95a-40fa-48ea-ae19-31cd14b28513 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:19:40 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Volume volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e (f9cc836d-9284-4a91-9b2f-aeab31e6220e): created successfully Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887e96ae-1f43-4bfd-a8d9-8927d4bed9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Flow 'volume_create_manager' (60169aec-0efb-45a6-b2dd-09f8fc86ba3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ed57db-1e45-46de-8c9d-952aa1d48d73]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:40 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:40 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-0788253d-1ae4-4eb8-935f-dbd48537fe7d tempest-CreateVolumesFromImageTest-1820553801 None] Created volume successfully. Sep 03 20:19:40 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 Sep 03 20:19:40 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:40 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Temporary image cf6ab9e3-80f7-4bcc-95ad-297c0743e113 is fetched for user 6b1dde4562334f10ac27b231cbdf3bae. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7b623f-4841-4920-9ab5-2c53e0bd7fc6]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:40 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD Sep 03 20:19:40 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:40 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513" returned: 0 in 0.398s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:40 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 1G Sep 03 20:19:40 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:40 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "cinder-f9cc836d-9284-4a91-9b2f-aeab31e6220e-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:40 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD Sep 03 20:19:40 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-f9cc836d-9284-4a91-9b2f-aeab31e6220e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "cinder-quobyte-f9cc836d-9284-4a91-9b2f-aeab31e6220e" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-quobyte-f9cc836d-9284-4a91-9b2f-aeab31e6220e" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6566939-cb8c-4919-b99b-deda2207c650]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:41 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:41 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e Sep 03 20:19:41 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:41 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 1G" returned: 0 in 0.499s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:41 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 Sep 03 20:19:41 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:41 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e" returned: 0 in 0.383s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:41 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e Sep 03 20:19:41 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:41 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66" returned: 0 in 0.323s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:41 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 is being set with open permissions: ugo+rw Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:41 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 Sep 03 20:19:41 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:41 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-f9cc836d-9284-4a91-9b2f-aeab31e6220e" returned: 0 in 0.256s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-quobyte-f9cc836d-9284-4a91-9b2f-aeab31e6220e" released by "delete_volume" :: held 0.683s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Created reservations ['3990f506-670b-4da8-8ee7-3e57c8682859', '9c8ce603-bbdf-433c-9b14-5530455952be', 'c82df9b8-4493-49af-9dde-46db520fdcf6', 'b52ff4fc-1421-4061-8fe4-a94d388dcbcc'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:41 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66" returned: 0 in 0.253s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:41 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.info Sep 03 20:19:41 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:41 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:41 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:41 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.info" returned: 0 in 0.290s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:41 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.info is being set with open permissions: ugo+rw Sep 03 20:19:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:41 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.info Sep 03 20:19:41 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:42 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.313s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "cinder-ff5c4e2a-0960-44c6-adec-8cae9a3631c0-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:42 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Deleted volume successfully. Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-ff5c4e2a-0960-44c6-adec-8cae9a3631c0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-90c707e4-44bb-43fa-8eaf-6147194a25e1 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-f9cc836d-9284-4a91-9b2f-aeab31e6220e-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "cinder-quobyte-ff5c4e2a-0960-44c6-adec-8cae9a3631c0" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-quobyte-ff5c4e2a-0960-44c6-adec-8cae9a3631c0" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b8a424-26ca-4f7d-9524-d95faba4a466]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:42 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.info" returned: 0 in 0.308s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.125s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd959370-1ac9-470e-9316-60d4628a9a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a51f815d9224facaef8773abea55e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:38Z,use_quota=True,user_id='20cb0b5f68b24dfeb5804925e2fd0373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Creating volume cd959370-1ac9-470e-9316-60d4628a9a15 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:42 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:42 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0 Sep 03 20:19:42 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:42 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 1073741824 Sep 03 20:19:42 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:42 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-fed29f25-9d37-43e6-b02a-709f919ab83e tempest-CreateVolumesFromSnapshotTest-1587215983 None] Create snapshot completed successfully Sep 03 20:19:42 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0" returned: 0 in 0.384s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:42 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0 Sep 03 20:19:42 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:42 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 1073741824" returned: 0 in 0.425s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:42 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 Sep 03 20:19:42 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:42 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ff5c4e2a-0960-44c6-adec-8cae9a3631c0" returned: 0 in 0.277s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-quobyte-ff5c4e2a-0960-44c6-adec-8cae9a3631c0" released by "delete_volume" :: held 0.707s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:42 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Created reservations ['b82079ae-e5a3-4c4f-a42d-6a8d5c9d183c', 'f50280cb-03f8-4bf1-8e31-4389890861eb', '7664a89c-6ddf-43c1-bce2-9972cf8d79f7', '462bd760-8fdf-4045-b249-6fb55b991199'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:43 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:43 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:43 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15" returned: 0 in 0.313s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.065s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bdfeda-e62c-4b9b-9cac-75babb145d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3bbb39c45f04d7db779c8226f4d94b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:39Z,use_quota=True,user_id='6b1dde4562334f10ac27b231cbdf3bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36387e55-cf38-433a-8e52-07a6cb48885d),volume_type_id=36387e55-cf38-433a-8e52-07a6cb48885d)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Creating volume 68bdfeda-e62c-4b9b-9cac-75babb145d47 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:43 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:43 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 1073741824 Sep 03 20:19:43 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Attempting download of 7beeb06b-6ab3-4c48-8328-cf0acc99d2b4 ((None, [{'url': 'file:///opt/stack/data/glance/images/7beeb06b-6ab3-4c48-8328-cf0acc99d2b4', 'metadata': {}}])) to volume cd959370-1ac9-470e-9316-60d4628a9a15. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[25234fe5-96b5-4a0d-bb7c-5d5f9d3a53b4]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_hltid546 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "cinder-fb304456-cd5a-4d8a-b5d8-4456b84fb084-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-fb304456-cd5a-4d8a-b5d8-4456b84fb084-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:43 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.484s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:43 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_hltid546 Sep 03 20:19:43 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Flow 'volume_create_manager' (b6d3d9ca-3d72-42d9-9b66-1e7ed08b4310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df879c64-3158-4546-9140-ce0a8d5c128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:43 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Deleted volume successfully. Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df879c64-3158-4546-9140-ce0a8d5c128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2016290738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65ced9e-376f-433a-afb3-108e46531c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236c9573150c44ec82979d359d03d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:43Z,use_quota=True,user_id='1e9b39dd75d74adda0f2f1b3facf4a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba67963-ea0a-496b-83d3-0311f7d19e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba67963-ea0a-496b-83d3-0311f7d19e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b96877b-bed0-4a5c-8cf0-2e59f1391c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b96877b-bed0-4a5c-8cf0-2e59f1391c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a65ced9e-376f-433a-afb3-108e46531c0f', 'volume_name': 'volume-a65ced9e-376f-433a-afb3-108e46531c0f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3821ac-4c53-420d-8600-6f3f6086e509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3821ac-4c53-420d-8600-6f3f6086e509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c02f33-5d5a-46e3-aaf5-984296954bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:43 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume a65ced9e-376f-433a-afb3-108e46531c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a65ced9e-376f-433a-afb3-108e46531c0f', 'volume_size': 1} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "cinder-quobyte-fb304456-cd5a-4d8a-b5d8-4456b84fb084" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-72eebc5f-83a8-4a88-be87-e86e65cb38ae tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-ff5c4e2a-0960-44c6-adec-8cae9a3631c0-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-quobyte-fb304456-cd5a-4d8a-b5d8-4456b84fb084" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[890dc94d-2659-4729-b115-b9fb92c46826]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:43 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 1073741824" returned: 0 in 0.670s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:43 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:43 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 Sep 03 20:19:43 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084 Sep 03 20:19:43 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:43 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_hltid546" returned: 0 in 0.579s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_hltid546 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:43 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Flow 'volume_create_manager' (96ff5b82-32ef-4489-9268-792645018d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5686cf5-998b-4432-a346-f2eb974917de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5686cf5-998b-4432-a346-f2eb974917de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-648343048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0292d7-812f-448f-9735-cf9108da146d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236c9573150c44ec82979d359d03d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:44Z,use_quota=True,user_id='1e9b39dd75d74adda0f2f1b3facf4a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01e5e95-e6e2-4c32-82d7-9873ddb0c86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:44 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_hltid546 Sep 03 20:19:44 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01e5e95-e6e2-4c32-82d7-9873ddb0c86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3928986-20c3-4d38-8f0c-0bacdd2b3e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3928986-20c3-4d38-8f0c-0bacdd2b3e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f0292d7-812f-448f-9735-cf9108da146d', 'volume_name': 'volume-3f0292d7-812f-448f-9735-cf9108da146d', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69821da1-159d-42fc-8e31-79a0042740d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69821da1-159d-42fc-8e31-79a0042740d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04b4dbe-97f3-456d-a965-8a973f7a1714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:44 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume 3f0292d7-812f-448f-9735-cf9108da146d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f0292d7-812f-448f-9735-cf9108da146d', 'volume_size': 1} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:44 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084" returned: 0 in 0.525s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:44 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47" returned: 0 in 0.424s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.639s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2016290738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65ced9e-376f-433a-afb3-108e46531c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236c9573150c44ec82979d359d03d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:43Z,use_quota=True,user_id='1e9b39dd75d74adda0f2f1b3facf4a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Creating volume a65ced9e-376f-433a-afb3-108e46531c0f {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:44 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a65ced9e-376f-433a-afb3-108e46531c0f 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:44 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084 Sep 03 20:19:44 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:44 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a65ced9e-376f-433a-afb3-108e46531c0f 1073741824 Sep 03 20:19:44 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Attempting download of cf6ab9e3-80f7-4bcc-95ad-297c0743e113 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6ab9e3-80f7-4bcc-95ad-297c0743e113', 'metadata': {}}])) to volume 68bdfeda-e62c-4b9b-9cac-75babb145d47. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 20:19:44 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_hltid546" returned: 1 in 0.517s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_hltid546' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e35ac41-2aa4-4e28-9ecd-3319ad867ddf]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfcea04-ae79-42f8-b618-e3f6b3743809]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_vxzebhdd {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Flow 'volume_create_manager' (db055180-a206-4e4a-b38f-6409160f3cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1181bea9-0912-4093-bbc1-eb0ee718d0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:44 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD Sep 03 20:19:44 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1181bea9-0912-4093-bbc1-eb0ee718d0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-560081523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236c9573150c44ec82979d359d03d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:45Z,use_quota=True,user_id='1e9b39dd75d74adda0f2f1b3facf4a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1ffa68-88b0-4e0f-a578-1a65567b6916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1ffa68-88b0-4e0f-a578-1a65567b6916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1da537b-6798-432d-9797-fe0a81d35a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1da537b-6798-432d-9797-fe0a81d35a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a', 'volume_name': 'volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728c04e0-f457-4670-84c1-1a949945a8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728c04e0-f457-4670-84c1-1a949945a8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112d7609-0e8e-492e-a77f-b9e31aeb4463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:44 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a', 'volume_size': 1} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:44 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_vxzebhdd Sep 03 20:19:44 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:44 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fb304456-cd5a-4d8a-b5d8-4456b84fb084" returned: 0 in 0.565s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-quobyte-fb304456-cd5a-4d8a-b5d8-4456b84fb084" released by "delete_volume" :: held 1.158s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:44 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:45 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a65ced9e-376f-433a-afb3-108e46531c0f 1073741824" returned: 0 in 0.740s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Created reservations ['46f352c2-f79d-45dd-95f2-9780b60ec0c8', '5a0bfba8-061b-4fe0-aab6-96d19ced3422', '694caeea-d6f7-4588-9986-4ddd51833291', '2104d306-d1e1-40bb-825e-33ffd8ec463c'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a65ced9e-376f-433a-afb3-108e46531c0f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:45 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_vxzebhdd" returned: 0 in 0.712s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:45 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a65ced9e-376f-433a-afb3-108e46531c0f Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_vxzebhdd {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:45 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:45 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD Sep 03 20:19:45 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:45 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:45 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Flow 'volume_create_manager' (8640f4c8-faa9-4258-a05b-e5f5fdf15d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87392d0f-ecef-4a0c-a410-a0bcccff025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:45 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_vxzebhdd Sep 03 20:19:45 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87392d0f-ecef-4a0c-a410-a0bcccff025b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1377812634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6daaed97-215f-4237-9702-bfa7a39b1eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236c9573150c44ec82979d359d03d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:45Z,use_quota=True,user_id='1e9b39dd75d74adda0f2f1b3facf4a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ec75c2-8163-4921-a24e-2e65e11d0168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ec75c2-8163-4921-a24e-2e65e11d0168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42430044-97c6-4832-bd46-06712d8c9100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42430044-97c6-4832-bd46-06712d8c9100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6daaed97-215f-4237-9702-bfa7a39b1eeb', 'volume_name': 'volume-6daaed97-215f-4237-9702-bfa7a39b1eeb', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:45 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4957486f-0c83-43d0-8235-e22d3e22e918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4957486f-0c83-43d0-8235-e22d3e22e918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d86a70-4aed-4707-ada3-909ad2f7c838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:45 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume 6daaed97-215f-4237-9702-bfa7a39b1eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6daaed97-215f-4237-9702-bfa7a39b1eeb', 'volume_size': 1} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD" returned: 1 in 0.576s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] 7beeb06b-6ab3-4c48-8328-cf0acc99d2b4 was raw, converting to qcow2 {{(pid=87582) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:45 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 Sep 03 20:19:45 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:45 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:45 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.405s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a65ced9e-376f-433a-afb3-108e46531c0f" returned: 0 in 0.553s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:45 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Deleted volume successfully. Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.601s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-648343048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0292d7-812f-448f-9735-cf9108da146d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236c9573150c44ec82979d359d03d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:44Z,use_quota=True,user_id='1e9b39dd75d74adda0f2f1b3facf4a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Creating volume 3f0292d7-812f-448f-9735-cf9108da146d {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:45 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0292d7-812f-448f-9735-cf9108da146d 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:45 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0292d7-812f-448f-9735-cf9108da146d 1073741824 Sep 03 20:19:45 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "cinder-c80ad292-3eac-464f-b001-eebcdfb561de-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c02f33-5d5a-46e3-aaf5-984296954bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65ced9e-376f-433a-afb3-108e46531c0f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953da722-1612-4503-b477-8a1ab8db61e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:45 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume volume-a65ced9e-376f-433a-afb3-108e46531c0f (a65ced9e-376f-433a-afb3-108e46531c0f): created successfully Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953da722-1612-4503-b477-8a1ab8db61e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:45 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Flow 'volume_create_manager' (b6d3d9ca-3d72-42d9-9b66-1e7ed08b4310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d85a0ca7-b9d5-473f-bf62-88b823712c7d tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-fb304456-cd5a-4d8a-b5d8-4456b84fb084-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-c80ad292-3eac-464f-b001-eebcdfb561de-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_vxzebhdd" returned: 1 in 0.732s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_vxzebhdd' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb0ceb4-982b-4a67-a5f1-17d8d5c14a18]: (4, 'raw') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:45 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c37aba44-5695-4a2c-a60d-84d3a6bd3790 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Created volume successfully. Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "cinder-quobyte-c80ad292-3eac-464f-b001-eebcdfb561de" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-quobyte-c80ad292-3eac-464f-b001-eebcdfb561de" acquired by "delete_volume" :: waited 0.033s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:46 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD Sep 03 20:19:46 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Flow 'volume_create_manager' (ed3c2f13-9d1f-4435-bf02-4f82dc60c0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60c5cec-6fcb-47a3-b6c4-023c6e5abe69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc396af0-c32d-4051-8729-92d4d4afa14d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c80ad292-3eac-464f-b001-eebcdfb561de {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60c5cec-6fcb-47a3-b6c4-023c6e5abe69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1818199585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835a0be5-6596-47a6-b120-9d20fc27d108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236c9573150c44ec82979d359d03d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:46Z,use_quota=True,user_id='1e9b39dd75d74adda0f2f1b3facf4a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52217aa4-a569-428e-9b3d-0c6cf5f54b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52217aa4-a569-428e-9b3d-0c6cf5f54b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756c68ec-58e2-4ea8-a77a-61276d34cf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756c68ec-58e2-4ea8-a77a-61276d34cf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '835a0be5-6596-47a6-b120-9d20fc27d108', 'volume_name': 'volume-835a0be5-6596-47a6-b120-9d20fc27d108', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1586b6-f82d-4140-acab-fa64853600db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1586b6-f82d-4140-acab-fa64853600db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5508518c-1eab-4957-a876-b7248c306401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:46 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume 835a0be5-6596-47a6-b120-9d20fc27d108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-835a0be5-6596-47a6-b120-9d20fc27d108', 'volume_size': 1} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:46 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c80ad292-3eac-464f-b001-eebcdfb561de Sep 03 20:19:46 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:46 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0292d7-812f-448f-9735-cf9108da146d 1073741824" returned: 0 in 0.565s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:46 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15" returned: 0 in 0.743s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7beeb06b-6ab3-4c48-8328-cf0acc99d2b4_rx7l3roodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:19:46 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0292d7-812f-448f-9735-cf9108da146d {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:46 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 1G Sep 03 20:19:46 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:46 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:46 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0292d7-812f-448f-9735-cf9108da146d Sep 03 20:19:46 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:46 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD Sep 03 20:19:46 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:46 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0292d7-812f-448f-9735-cf9108da146d" returned: 0 in 0.295s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:46 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.934s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-560081523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236c9573150c44ec82979d359d03d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:45Z,use_quota=True,user_id='1e9b39dd75d74adda0f2f1b3facf4a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Creating volume d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:46 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c80ad292-3eac-464f-b001-eebcdfb561de" returned: 0 in 0.578s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c80ad292-3eac-464f-b001-eebcdfb561de {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:46 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a 1073741824 Sep 03 20:19:46 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:46 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04b4dbe-97f3-456d-a965-8a973f7a1714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0292d7-812f-448f-9735-cf9108da146d', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cc1164-93e9-436c-8943-a510b9f3a347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 20:19:46 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c80ad292-3eac-464f-b001-eebcdfb561de Sep 03 20:19:46 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] cf6ab9e3-80f7-4bcc-95ad-297c0743e113 was raw, converting to qcow2 {{(pid=87582) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:46 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:46 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume volume-3f0292d7-812f-448f-9735-cf9108da146d (3f0292d7-812f-448f-9735-cf9108da146d): created successfully Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cc1164-93e9-436c-8943-a510b9f3a347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:46 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 Sep 03 20:19:46 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Flow 'volume_create_manager' (96ff5b82-32ef-4489-9268-792645018d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 1G" returned: 0 in 0.481s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Downloaded image 7beeb06b-6ab3-4c48-8328-cf0acc99d2b4 ((None, [{'url': 'file:///opt/stack/data/glance/images/7beeb06b-6ab3-4c48-8328-cf0acc99d2b4', 'metadata': {}}])) to volume cd959370-1ac9-470e-9316-60d4628a9a15 successfully. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Temporary image 7beeb06b-6ab3-4c48-8328-cf0acc99d2b4 for user 20cb0b5f68b24dfeb5804925e2fd0373 is deleted. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Marking volume cd959370-1ac9-470e-9316-60d4628a9a15 as bootable. {{(pid=87582) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 20:19:46 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b827bc6d-0a0f-4a6e-a969-491eac754472 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Created volume successfully. Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Copying metadata from image 7beeb06b-6ab3-4c48-8328-cf0acc99d2b4 to cd959370-1ac9-470e-9316-60d4628a9a15. {{(pid=87582) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Creating volume glance metadata for volume cd959370-1ac9-470e-9316-60d4628a9a15 backed by image 7beeb06b-6ab3-4c48-8328-cf0acc99d2b4 with: {'image_id': '7beeb06b-6ab3-4c48-8328-cf0acc99d2b4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3c0cf87ba209927ea618538e3859fcff', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87582) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493ffc98-81fc-4436-abc2-15a524ce0f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd959370-1ac9-470e-9316-60d4628a9a15', 'volume_size': 1, 'image_id': '7beeb06b-6ab3-4c48-8328-cf0acc99d2b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7beeb06b-6ab3-4c48-8328-cf0acc99d2b4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c0cf87ba209927ea618538e3859fcff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3a51f815d9224facaef8773abea55e0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1fefad721ffa56c164ab1dc83d9fee22a6b6a6233afdbb1609c6c47a8b0fb13ee013f6ea3562e5de2681b490b3e5ff77d2917821936975beb9084f84a993d4f9', 'id': '7beeb06b-6ab3-4c48-8328-cf0acc99d2b4', 'created_at': datetime.datetime(2026, 9, 3, 18, 19, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 19, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7beeb06b-6ab3-4c48-8328-cf0acc99d2b4/file', 'properties': {}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a074073e-ceed-44f3-98b2-b40a6c9c3e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:46 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Volume volume-cd959370-1ac9-470e-9316-60d4628a9a15 (cd959370-1ac9-470e-9316-60d4628a9a15): created successfully Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a074073e-ceed-44f3-98b2-b40a6c9c3e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:46 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Flow 'volume_create_manager' (42daedab-2e90-4d70-9049-3e62af872d72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:46 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-56461d9f-9551-4c59-8292-a54ccff5482f tempest-VolumeImageDependencyTests-1504952038 None] Created volume successfully. Sep 03 20:19:47 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-c80ad292-3eac-464f-b001-eebcdfb561de" returned: 0 in 0.463s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-quobyte-c80ad292-3eac-464f-b001-eebcdfb561de" released by "delete_volume" :: held 1.113s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Created reservations ['70c08132-1dcd-4e5b-9ce9-7debab6de99c', '7e9cc2ed-b810-4522-91d5-7ceee6383810', '2ff6df08-b660-4f31-aecc-5d10e53a3c6b', '93a2760b-50b5-4aa2-8c75-e9b96f1929c3'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:47 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a 1073741824" returned: 0 in 0.573s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:47 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47" returned: 0 in 0.577s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf6ab9e3-80f7-4bcc-95ad-297c0743e113_tydrhflcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:19:47 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:47 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a Sep 03 20:19:47 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:47 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 1G Sep 03 20:19:47 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:47 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:47 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:47 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a" returned: 0 in 0.292s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.028s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1377812634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6daaed97-215f-4237-9702-bfa7a39b1eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236c9573150c44ec82979d359d03d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:45Z,use_quota=True,user_id='1e9b39dd75d74adda0f2f1b3facf4a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Creating volume 6daaed97-215f-4237-9702-bfa7a39b1eeb {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:47 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6daaed97-215f-4237-9702-bfa7a39b1eeb 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:47 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:47 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6daaed97-215f-4237-9702-bfa7a39b1eeb 1073741824 Sep 03 20:19:47 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112d7609-0e8e-492e-a77f-b9e31aeb4463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f0a25a-1709-4671-94ab-e6ea523be309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.316s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Deleted volume successfully. Sep 03 20:19:47 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a (d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a): created successfully Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f0a25a-1709-4671-94ab-e6ea523be309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Flow 'volume_create_manager' (db055180-a206-4e4a-b38f-6409160f3cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Acquiring lock "cinder-cd959370-1ac9-470e-9316-60d4628a9a15-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:47 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-63590e7e-7dce-4c06-a48a-d1710714e541 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Created volume successfully. Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-29f062d0-6d62-4d28-acb9-a7527427420f tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-c80ad292-3eac-464f-b001-eebcdfb561de-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 1G" returned: 0 in 0.440s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Downloaded image cf6ab9e3-80f7-4bcc-95ad-297c0743e113 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf6ab9e3-80f7-4bcc-95ad-297c0743e113', 'metadata': {}}])) to volume 68bdfeda-e62c-4b9b-9cac-75babb145d47 successfully. {{(pid=87582) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Temporary image cf6ab9e3-80f7-4bcc-95ad-297c0743e113 for user 6b1dde4562334f10ac27b231cbdf3bae is deleted. {{(pid=87582) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.volume_utils [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Marking volume 68bdfeda-e62c-4b9b-9cac-75babb145d47 as bootable. {{(pid=87582) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Lock "cinder-cd959370-1ac9-470e-9316-60d4628a9a15-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Copying metadata from image cf6ab9e3-80f7-4bcc-95ad-297c0743e113 to 68bdfeda-e62c-4b9b-9cac-75babb145d47. {{(pid=87582) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Creating volume glance metadata for volume 68bdfeda-e62c-4b9b-9cac-75babb145d47 backed by image cf6ab9e3-80f7-4bcc-95ad-297c0743e113 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cf6ab9e3-80f7-4bcc-95ad-297c0743e113', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'dead2d61d38f6ddbed9bfb61e7e506ed', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87582) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Acquiring lock "cinder-quobyte-cd959370-1ac9-470e-9316-60d4628a9a15" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Lock "cinder-quobyte-cd959370-1ac9-470e-9316-60d4628a9a15" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0df94be-90b3-48f7-96ef-7eae9e1ddfde]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9268e14e-bddb-4e67-a5cd-a7234c854ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68bdfeda-e62c-4b9b-9cac-75babb145d47', 'volume_size': 1, 'image_id': 'cf6ab9e3-80f7-4bcc-95ad-297c0743e113', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf6ab9e3-80f7-4bcc-95ad-297c0743e113', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dead2d61d38f6ddbed9bfb61e7e506ed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3bbb39c45f04d7db779c8226f4d94b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31b9c3fce6c818e9fff4bed909497a1aa4559981c3ff5fd63ba543d7984a34a9335635241be73065d0e69e26ebe39b30d485f0049a4c167a86ccf6782f07c3fc', 'id': 'cf6ab9e3-80f7-4bcc-95ad-297c0743e113', 'created_at': datetime.datetime(2026, 9, 3, 18, 19, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 18, 19, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf6ab9e3-80f7-4bcc-95ad-297c0743e113/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d915ce-840f-4c36-ba3a-8a305624fad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:47 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Volume volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 (68bdfeda-e62c-4b9b-9cac-75babb145d47): created successfully Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d915ce-840f-4c36-ba3a-8a305624fad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Flow 'volume_create_manager' (c4fa2f32-b0de-41cd-8416-21ecdff69b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-647fbd49-3604-4654-b305-549feffdfdcb tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Created volume successfully. Sep 03 20:19:47 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 Sep 03 20:19:47 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "cinder-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:48 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6daaed97-215f-4237-9702-bfa7a39b1eeb 1073741824" returned: 0 in 0.548s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "cinder-quobyte-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6daaed97-215f-4237-9702-bfa7a39b1eeb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-quobyte-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb" acquired by "delete_volume" :: waited 0.038s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:48 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6daaed97-215f-4237-9702-bfa7a39b1eeb Sep 03 20:19:48 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e289d4-b06d-4f01-a99d-ebb1f73f5518]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:48 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15" returned: 0 in 0.442s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:48 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15 Sep 03 20:19:48 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:48 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb Sep 03 20:19:48 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:48 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6daaed97-215f-4237-9702-bfa7a39b1eeb" returned: 0 in 0.300s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.339s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1818199585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835a0be5-6596-47a6-b120-9d20fc27d108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236c9573150c44ec82979d359d03d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:46Z,use_quota=True,user_id='1e9b39dd75d74adda0f2f1b3facf4a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Creating volume 835a0be5-6596-47a6-b120-9d20fc27d108 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:48 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-835a0be5-6596-47a6-b120-9d20fc27d108 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:48 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d86a70-4aed-4707-ada3-909ad2f7c838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6daaed97-215f-4237-9702-bfa7a39b1eeb', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ff13ae-610e-48c0-959a-bb150b60ad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:48 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-835a0be5-6596-47a6-b120-9d20fc27d108 1073741824 Sep 03 20:19:48 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cd959370-1ac9-470e-9316-60d4628a9a15" returned: 0 in 0.272s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:48 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume volume-6daaed97-215f-4237-9702-bfa7a39b1eeb (6daaed97-215f-4237-9702-bfa7a39b1eeb): created successfully Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ff13ae-610e-48c0-959a-bb150b60ad22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Flow 'volume_create_manager' (8640f4c8-faa9-4258-a05b-e5f5fdf15d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Lock "cinder-quobyte-cd959370-1ac9-470e-9316-60d4628a9a15" released by "delete_volume" :: held 0.774s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-fc33b1c7-c1af-446a-aba5-fed6fb190953 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Created volume successfully. Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Created reservations ['01434e92-1999-4247-b67c-4d01060c0799', '78207408-ad59-4347-82c5-2719cfcb7546', 'ceecf97a-6e19-4072-a0c2-30f22a208e22', 'd2fa899b-22e4-4c33-a73d-8e3b1fbc5d22'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:48 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb" returned: 0 in 0.425s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:48 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb Sep 03 20:19:48 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:48 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:48 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Acquiring lock "cinder-68bdfeda-e62c-4b9b-9cac-75babb145d47-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Lock "cinder-68bdfeda-e62c-4b9b-9cac-75babb145d47-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Acquiring lock "cinder-quobyte-68bdfeda-e62c-4b9b-9cac-75babb145d47" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Lock "cinder-quobyte-68bdfeda-e62c-4b9b-9cac-75babb145d47" acquired by "delete_volume" :: waited 0.038s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:49 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb" returned: 0 in 0.450s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d392c2f2-12fb-478c-8ae2-dc77a71a9702]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-quobyte-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb" released by "delete_volume" :: held 0.949s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:49 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-835a0be5-6596-47a6-b120-9d20fc27d108 1073741824" returned: 0 in 0.710s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:49 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.487s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:49 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Deleted volume successfully. Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-835a0be5-6596-47a6-b120-9d20fc27d108 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Created reservations ['465e3a84-5e55-4cac-ba02-925e0170ec18', 'eb5e3e7d-2b3e-46cf-bae4-6da9c7c3de78', 'b653f97f-a80d-4547-afae-592c7b0927c0', 'a9cea4c4-254b-40e9-a73e-c59ff0196797'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:49 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 Sep 03 20:19:49 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7895dc37-0b8d-4925-a149-91daad539e33 tempest-VolumeImageDependencyTests-1504952038 None] Lock "cinder-cd959370-1ac9-470e-9316-60d4628a9a15-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:49 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-835a0be5-6596-47a6-b120-9d20fc27d108 Sep 03 20:19:49 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:49 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:49 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:49 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47" returned: 0 in 0.591s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:49 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47 Sep 03 20:19:49 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:49 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.323s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:49 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Deleted volume successfully. Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-090756f1-9440-42f9-8864-a2aba0ef2910 tempest-CreateVolumesFromImageTest-1820553801 None] Lock "cinder-cfe5f03f-c79a-4e79-809d-1e6ef97c89cb-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:49 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-835a0be5-6596-47a6-b120-9d20fc27d108" returned: 0 in 0.553s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5508518c-1eab-4957-a876-b7248c306401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835a0be5-6596-47a6-b120-9d20fc27d108', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d7920f-285c-4dcb-a23c-677818cc81d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:49 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Volume volume-835a0be5-6596-47a6-b120-9d20fc27d108 (835a0be5-6596-47a6-b120-9d20fc27d108): created successfully Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d7920f-285c-4dcb-a23c-677818cc81d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Flow 'volume_create_manager' (ed3c2f13-9d1f-4435-bf02-4f82dc60c0d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:49 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-fadca26f-b83d-42ba-8214-a1e0cf146e46 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Created volume successfully. Sep 03 20:19:50 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-68bdfeda-e62c-4b9b-9cac-75babb145d47" returned: 0 in 0.365s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Lock "cinder-quobyte-68bdfeda-e62c-4b9b-9cac-75babb145d47" released by "delete_volume" :: held 1.018s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Created reservations ['8cfbb77f-dc57-487c-9d4f-b95f4e12e372', 'd66f350a-49af-4fdd-8693-4278cc2cb678', '847f138a-b4df-494f-aadc-732b166c3dfc', 'e74474d5-ca3d-473e-a9f3-cc30bb8897b0'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:50 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:50 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:50 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.350s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Deleted volume successfully. Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cf7ba062-9d10-4280-a6fd-564ed8f0b959 tempest-VolumeAndVolumeTypeFromImageTest-263246772 None] Lock "cinder-68bdfeda-e62c-4b9b-9cac-75babb145d47-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-835a0be5-6596-47a6-b120-9d20fc27d108-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-835a0be5-6596-47a6-b120-9d20fc27d108-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-quobyte-835a0be5-6596-47a6-b120-9d20fc27d108" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-835a0be5-6596-47a6-b120-9d20fc27d108" acquired by "delete_volume" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[81147893-6566-4243-8d8b-5837b3c92e7c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-835a0be5-6596-47a6-b120-9d20fc27d108 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:50 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-835a0be5-6596-47a6-b120-9d20fc27d108 Sep 03 20:19:50 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:51 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-835a0be5-6596-47a6-b120-9d20fc27d108" returned: 0 in 0.457s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-835a0be5-6596-47a6-b120-9d20fc27d108 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:51 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-835a0be5-6596-47a6-b120-9d20fc27d108 Sep 03 20:19:51 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:51 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-835a0be5-6596-47a6-b120-9d20fc27d108" returned: 0 in 0.347s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-835a0be5-6596-47a6-b120-9d20fc27d108" released by "delete_volume" :: held 0.859s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:51 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Created reservations ['7adf0025-7cc3-4fc7-9d34-de53a2349a58', '6d015651-e980-4974-b78c-583b9ceea89a', '83a9348d-7fd8-4363-a2f9-7d9ac852b555', 'efcf6624-df1f-4e0b-b1c5-a21cd1203682'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:51 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:51 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-6daaed97-215f-4237-9702-bfa7a39b1eeb-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-6daaed97-215f-4237-9702-bfa7a39b1eeb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-quobyte-6daaed97-215f-4237-9702-bfa7a39b1eeb" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-6daaed97-215f-4237-9702-bfa7a39b1eeb" acquired by "delete_volume" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2b7608-cd9b-4244-99f9-f4561fb65c49]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6daaed97-215f-4237-9702-bfa7a39b1eeb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:52 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.324s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Deleted volume successfully. Sep 03 20:19:52 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6daaed97-215f-4237-9702-bfa7a39b1eeb Sep 03 20:19:52 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-4e118d7c-7015-40bc-ab4d-d55f98003df7 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-835a0be5-6596-47a6-b120-9d20fc27d108-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:52 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6daaed97-215f-4237-9702-bfa7a39b1eeb" returned: 0 in 0.444s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6daaed97-215f-4237-9702-bfa7a39b1eeb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:52 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6daaed97-215f-4237-9702-bfa7a39b1eeb Sep 03 20:19:52 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:52 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6daaed97-215f-4237-9702-bfa7a39b1eeb" returned: 0 in 0.295s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-6daaed97-215f-4237-9702-bfa7a39b1eeb" released by "delete_volume" :: held 0.781s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:52 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Created reservations ['5103410d-f035-4f56-a103-e95cba7a2648', '35b2fad8-8a7e-457f-a193-a4eb847c77d1', '9bb7a181-fb00-4e62-b7d6-4a7596787c0e', 'f75cd67e-2c5a-4e2b-b6d8-1351a0eba407'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:53 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:53 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-quobyte-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:53 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.384s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaeb37e-60d5-4617-a0e8-1513303ea7e8]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:53 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Deleted volume successfully. Sep 03 20:19:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-50d6d170-bb05-4cc8-8686-3882d875c4aa tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-6daaed97-215f-4237-9702-bfa7a39b1eeb-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:53 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a Sep 03 20:19:53 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:54 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a" returned: 0 in 0.552s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:54 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a Sep 03 20:19:54 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:54 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a" returned: 0 in 0.307s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a" released by "delete_volume" :: held 0.916s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:54 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Created reservations ['ed6a554b-2874-45be-b6f7-4eb0fe47f7a9', 'c11fc2bd-83bb-4589-a494-628343a25b56', '088aff93-4ef6-45e0-98cb-5806c28b4e02', '7c11b9bc-0bbf-44c9-9c7a-08794b5eeb97'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:54 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:54 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-3f0292d7-812f-448f-9735-cf9108da146d-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:55 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.509s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-3f0292d7-812f-448f-9735-cf9108da146d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:55 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Deleted volume successfully. Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-51626e90-7d4d-4d45-9eea-9cbe9c53f24d tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-d3a395c9-e5e3-4cb4-a50a-0220cc0a1a6a-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-quobyte-3f0292d7-812f-448f-9735-cf9108da146d" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-3f0292d7-812f-448f-9735-cf9108da146d" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce8a16e-7eab-46eb-a2d8-d3062f151d74]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0292d7-812f-448f-9735-cf9108da146d {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Flow 'volume_create_manager' (fb6a8186-295e-4a84-9b4e-66573d7db0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8cc307-ae25-4ba5-a394-2350af51c771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8cc307-ae25-4ba5-a394-2350af51c771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-100744843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56859b7c-f32b-4743-a6ef-268f3af7fbe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce034bd85287437682dc3773d6a365ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:55Z,use_quota=True,user_id='0963abf6298c4393a7163fc7a08bdf17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07634eae-ef88-4c5a-baee-65a157d42274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07634eae-ef88-4c5a-baee-65a157d42274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b95e2f1-34f6-499d-8a99-b80fe0e9ada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b95e2f1-34f6-499d-8a99-b80fe0e9ada0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56859b7c-f32b-4743-a6ef-268f3af7fbe2', 'volume_name': 'volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad244d2c-13d2-43ef-b835-eb0d182270e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad244d2c-13d2-43ef-b835-eb0d182270e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6569b8-dff2-46d6-beb1-9fea475abf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:55 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Volume 56859b7c-f32b-4743-a6ef-268f3af7fbe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2', 'volume_size': 1} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-100744843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56859b7c-f32b-4743-a6ef-268f3af7fbe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce034bd85287437682dc3773d6a365ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:55Z,use_quota=True,user_id='0963abf6298c4393a7163fc7a08bdf17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Creating volume 56859b7c-f32b-4743-a6ef-268f3af7fbe2 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:55 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0292d7-812f-448f-9735-cf9108da146d Sep 03 20:19:55 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:55 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:55 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 1073741824 Sep 03 20:19:55 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (030192d6-46ea-470d-bd56-12cff29fdd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a5a432-1c61-408c-8e32-96b7b0c6bfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a5a432-1c61-408c-8e32-96b7b0c6bfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2125129265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a4f02b-bdf8-43b5-974d-0cf76b7ba34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:55Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c73b4d0-bf66-4075-8941-41a5d6633203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c73b4d0-bf66-4075-8941-41a5d6633203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff1c7ed-56d6-4d25-b367-f90183d72c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff1c7ed-56d6-4d25-b367-f90183d72c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a4f02b-bdf8-43b5-974d-0cf76b7ba34f', 'volume_name': 'volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66cac860-005d-487d-a1f4-197449c92cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66cac860-005d-487d-a1f4-197449c92cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887c2924-1655-4744-8d84-6d9921469255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:55 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Volume 12a4f02b-bdf8-43b5-974d-0cf76b7ba34f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f', 'volume_size': 1} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:55 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0292d7-812f-448f-9735-cf9108da146d" returned: 0 in 0.470s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0292d7-812f-448f-9735-cf9108da146d {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:55 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0292d7-812f-448f-9735-cf9108da146d Sep 03 20:19:55 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:55 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 1073741824" returned: 0 in 0.531s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:56 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3f0292d7-812f-448f-9735-cf9108da146d" returned: 0 in 0.303s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:56 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 Sep 03 20:19:56 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-3f0292d7-812f-448f-9735-cf9108da146d" released by "delete_volume" :: held 0.847s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Created reservations ['02363b5f-6c2b-4d84-bf4b-633a7a2096c6', '50dab785-d207-4c0d-9bc2-e55ae7f7b23a', '69dcb06f-976d-4447-8b1c-1d33baaf98de', 'ecf11f94-dada-482a-bde4-20a32dd522d0'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:56 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:56 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-a65ced9e-376f-433a-afb3-108e46531c0f-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:56 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2" returned: 0 in 0.344s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-a65ced9e-376f-433a-afb3-108e46531c0f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.782s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2125129265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a4f02b-bdf8-43b5-974d-0cf76b7ba34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:55Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Creating volume 12a4f02b-bdf8-43b5-974d-0cf76b7ba34f {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:56 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:56 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f 1073741824 Sep 03 20:19:56 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6569b8-dff2-46d6-beb1-9fea475abf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e1d051-600b-434c-8b47-2bc8f60eadf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:56 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Volume volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 (56859b7c-f32b-4743-a6ef-268f3af7fbe2): created successfully Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e1d051-600b-434c-8b47-2bc8f60eadf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Flow 'volume_create_manager' (fb6a8186-295e-4a84-9b4e-66573d7db0ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-quobyte-a65ced9e-376f-433a-afb3-108e46531c0f" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5ee886e7-9bbe-4643-b5b1-717deb1e78fe tempest-VolumeDependencyTests-294634065 None] Created volume successfully. Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-a65ced9e-376f-433a-afb3-108e46531c0f" acquired by "delete_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaf044e-760b-41bc-97b1-28cb481c509a]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a65ced9e-376f-433a-afb3-108e46531c0f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:56 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.315s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Deleted volume successfully. Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-467fac8c-f543-4ffc-ba09-f873ddc13347 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-3f0292d7-812f-448f-9735-cf9108da146d-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:56 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a65ced9e-376f-433a-afb3-108e46531c0f Sep 03 20:19:56 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:56 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f 1073741824" returned: 0 in 0.485s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:56 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f Sep 03 20:19:56 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:56 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a65ced9e-376f-433a-afb3-108e46531c0f" returned: 0 in 0.462s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a65ced9e-376f-433a-afb3-108e46531c0f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:57 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a65ced9e-376f-433a-afb3-108e46531c0f Sep 03 20:19:57 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:57 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f" returned: 0 in 0.265s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887c2924-1655-4744-8d84-6d9921469255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9e8419-4f7a-4244-8769-14e48c7beaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:57 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Volume volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f (12a4f02b-bdf8-43b5-974d-0cf76b7ba34f): created successfully Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9e8419-4f7a-4244-8769-14e48c7beaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (030192d6-46ea-470d-bd56-12cff29fdd18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:57 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-fb61185f-c166-4121-bdad-03299d3bb945 tempest-ProjectMemberTests-371943627 None] Created volume successfully. Sep 03 20:19:57 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a65ced9e-376f-433a-afb3-108e46531c0f" returned: 0 in 0.298s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-a65ced9e-376f-433a-afb3-108e46531c0f" released by "delete_volume" :: held 0.816s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Created reservations ['d00249db-7c97-4865-b942-0ca8c66d1799', 'a77691a4-1837-447d-8715-1a1f3095bce4', 'cd4d2a71-a1ff-42df-ab52-658f6d00809e', 'd0d90866-3cb1-4cff-a454-7841346e2c65'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:57 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:19:57 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-ac94b346-077d-4fe6-ad9c-a2e64da1fa66-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-ac94b346-077d-4fe6-ad9c-a2e64da1fa66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-quobyte-ed8cf95a-40fa-48ea-ae19-31cd14b28513" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-ed8cf95a-40fa-48ea-ae19-31cd14b28513" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-quobyte-ac94b346-077d-4fe6-ad9c-a2e64da1fa66" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-ac94b346-077d-4fe6-ad9c-a2e64da1fa66" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Deleting offline snapshot ac94b346-077d-4fe6-ad9c-a2e64da1fa66 of volume ed8cf95a-40fa-48ea-ae19-31cd14b28513 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] snapshot_file for this snap is: volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f287ad-6dcf-4a45-8fa0-095d03d8eb1d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:19:57 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Flow 'volume_create_manager' (73900b84-c43a-4fb2-a318-e7ce6d413984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df047523-80ff-4b69-9cf3-b51d85b8ec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.361s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] Creating offline snapshot d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 of volume 56859b7c-f32b-4743-a6ef-268f3af7fbe2 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:19:57 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 Sep 03 20:19:57 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df047523-80ff-4b69-9cf3-b51d85b8ec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc8eb4e85a7462287fc66bfa96c796d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:58Z,use_quota=True,user_id='53d3d1a77a2d4074b80f69c1f2a9dfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3b09eb-ed27-4de7-aa9e-1aadf3dacd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3b09eb-ed27-4de7-aa9e-1aadf3dacd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7594372-a975-4eb8-95e0-5aaa0858123a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7594372-a975-4eb8-95e0-5aaa0858123a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9', 'volume_name': 'volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b6c9ac-0602-4328-9098-9e19deaa6611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b6c9ac-0602-4328-9098-9e19deaa6611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793517ab-30b2-4b31-9b44-aef0573bc1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:19:57 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Volume 57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9', 'volume_size': 1} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:57 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Deleted volume successfully. Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[18901d77-05cf-4172-a2b1-e383ab50bf5c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7a53033c-9204-4be2-89e0-91abe06c3d6f tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-a65ced9e-376f-433a-afb3-108e46531c0f-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:58 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 Sep 03 20:19:58 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:58 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66" returned: 0 in 0.393s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:19:58 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d35fce1-4e2d-4fc3-ac0e-01f03af06734]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:58 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 Sep 03 20:19:58 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:58 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2" returned: 0 in 0.378s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:58 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 1G Sep 03 20:19:58 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:58 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513" returned: 0 in 0.381s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:58 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 Sep 03 20:19:58 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:58 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 1G" returned: 0 in 0.437s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:58 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 Sep 03 20:19:58 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:58 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66" returned: 0 in 0.415s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:58 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66 Sep 03 20:19:58 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:59 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5" returned: 0 in 0.322s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:59 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 is being set with open permissions: ugo+rw Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:59 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 Sep 03 20:19:59 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:59 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513.ac94b346-077d-4fe6-ad9c-a2e64da1fa66" returned: 0 in 0.302s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:59 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5" returned: 0 in 0.255s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-ac94b346-077d-4fe6-ad9c-a2e64da1fa66" released by "_delete_snapshot" :: held 1.627s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-ed8cf95a-40fa-48ea-ae19-31cd14b28513" released by "delete_snapshot" :: held 1.655s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:59 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.info Sep 03 20:19:59 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Created reservations ['307c6945-ee05-42de-8048-1fd33197183b', '69a8a4a4-6936-42a5-83cf-02010d29c34f', 'ab924140-6f65-47ab-8228-857a549d18ce', 'e736afe5-8fca-4584-a57c-cb31a8b66032'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:19:59 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Delete snapshot completed successfully. Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9cfe70a6-e501-4f7c-a463-ebbacc5d9477 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-ac94b346-077d-4fe6-ad9c-a2e64da1fa66-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:19:59 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.info" returned: 0 in 0.244s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:59 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.info is being set with open permissions: ugo+rw Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:59 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.info Sep 03 20:19:59 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-ed8cf95a-40fa-48ea-ae19-31cd14b28513-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-ed8cf95a-40fa-48ea-ae19-31cd14b28513-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "cinder-quobyte-ed8cf95a-40fa-48ea-ae19-31cd14b28513" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:19:59 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.info" returned: 0 in 0.284s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.115s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-ed8cf95a-40fa-48ea-ae19-31cd14b28513" acquired by "delete_volume" :: waited 0.031s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.028s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc8eb4e85a7462287fc66bfa96c796d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:19:58Z,use_quota=True,user_id='53d3d1a77a2d4074b80f69c1f2a9dfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Creating volume 57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:19:59 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68972a9-9a11-4be9-8cd5-86ade67b01d3]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:19:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:19:59 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9 1073741824 Sep 03 20:19:59 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:19:59 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7be88a5e-8a9a-44a2-a165-3965742a9519 tempest-VolumeDependencyTests-294634065 None] Create snapshot completed successfully Sep 03 20:20:00 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 Sep 03 20:20:00 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:00 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513" returned: 0 in 0.374s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:00 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513 Sep 03 20:20:00 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:00 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9 1073741824" returned: 0 in 0.438s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:00 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9 Sep 03 20:20:00 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:00 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ed8cf95a-40fa-48ea-ae19-31cd14b28513" returned: 0 in 0.255s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-quobyte-ed8cf95a-40fa-48ea-ae19-31cd14b28513" released by "delete_volume" :: held 0.707s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Created reservations ['5937549d-ea91-4ee9-962c-e1a9b6c8bc1d', '19fb3b10-6ada-4d89-a823-423693ca1e59', 'cbf4bc27-dc6e-42c8-8e7a-c92a00461e30', 'ea381470-7743-409f-9c76-ceb0f2581dab'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:00 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9" returned: 0 in 0.265s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.840s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793517ab-30b2-4b31-9b44-aef0573bc1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc76853-97da-468a-a2e7-6938f45bdacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] Creating offline snapshot 82f53046-edd3-407e-8ede-e556ccafe648 of volume 12a4f02b-bdf8-43b5-974d-0cf76b7ba34f {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[314744f1-020b-4d5e-ae68-7167ade948ab]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:00 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Volume volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9 (57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9): created successfully Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc76853-97da-468a-a2e7-6938f45bdacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Flow 'volume_create_manager' (73900b84-c43a-4fb2-a318-e7ce6d413984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:00 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a5722de9-f2f6-465b-aeee-c8a40fab652b tempest-CinderUnicodeTest-817775336 None] Created volume successfully. Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:00 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:00 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:00 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f Sep 03 20:20:00 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:01 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.311s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:01 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Deleted volume successfully. Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8565ff89-8054-4bac-b52e-24e66d95b112 tempest-CreateVolumesFromSnapshotTest-1587215983 None] Lock "cinder-ed8cf95a-40fa-48ea-ae19-31cd14b28513-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:01 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f" returned: 0 in 0.477s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:01 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 1G Sep 03 20:20:01 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Flow 'volume_create_manager' (06bf05bc-69ee-4bdd-b49e-0354033413fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cd4f06-2cd4-485c-9769-9247d3145ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cd4f06-2cd4-485c-9769-9247d3145ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-716184092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc47939b-7319-4373-819e-39ef697b8e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce034bd85287437682dc3773d6a365ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d83eb5de-5d0a-4b3e-87c4-62d6509a86c5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:01Z,use_quota=True,user_id='0963abf6298c4393a7163fc7a08bdf17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2236693b-2f09-4e88-b2f6-9d8ee0f11ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2236693b-2f09-4e88-b2f6-9d8ee0f11ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88541fe-ff28-454f-9df2-40b8f0337460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88541fe-ff28-454f-9df2-40b8f0337460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fc47939b-7319-4373-819e-39ef697b8e83', 'volume_name': 'volume-fc47939b-7319-4373-819e-39ef697b8e83', 'volume_size': 1, 'snapshot_id': 'd83eb5de-5d0a-4b3e-87c4-62d6509a86c5'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30105ace-7b09-40c2-9506-0e6cbe57e0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30105ace-7b09-40c2-9506-0e6cbe57e0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12cbe56-69f1-4abb-baa0-ec9a7e1aa3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:01 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Volume fc47939b-7319-4373-819e-39ef697b8e83: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fc47939b-7319-4373-819e-39ef697b8e83', 'volume_size': 1, 'snapshot_id': 'd83eb5de-5d0a-4b3e-87c4-62d6509a86c5'} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:01 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 1G" returned: 0 in 0.482s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:01 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 Sep 03 20:20:01 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:02 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648" returned: 0 in 0.393s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:02 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 is being set with open permissions: ugo+rw Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:02 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 Sep 03 20:20:02 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:02 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648" returned: 0 in 0.336s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:02 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.info Sep 03 20:20:02 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Flow 'volume_create_manager' (d162bb20-76af-452c-a46a-bc62ffcf5296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf1056e-7e29-4a56-bc38-85706e3992c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf1056e-7e29-4a56-bc38-85706e3992c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-714761060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624fd3d8-665a-447a-8104-32d0d84a9f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc8eb4e85a7462287fc66bfa96c796d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:03Z,use_quota=True,user_id='53d3d1a77a2d4074b80f69c1f2a9dfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5345551-7013-4904-8476-fd5f9812b2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5345551-7013-4904-8476-fd5f9812b2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58610d6-aad7-4f42-8363-1d3cb6dfb853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58610d6-aad7-4f42-8363-1d3cb6dfb853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '624fd3d8-665a-447a-8104-32d0d84a9f05', 'volume_name': 'volume-624fd3d8-665a-447a-8104-32d0d84a9f05', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe64e4f-2409-4ea0-a95d-12ac11ad6903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe64e4f-2409-4ea0-a95d-12ac11ad6903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38588404-fcd9-48d0-a160-418886894a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:02 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Volume 624fd3d8-665a-447a-8104-32d0d84a9f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-624fd3d8-665a-447a-8104-32d0d84a9f05', 'volume_size': 1} Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:02 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.info" returned: 0 in 0.299s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:02 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.info is being set with open permissions: ugo+rw Sep 03 20:20:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:02 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.info Sep 03 20:20:02 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:03 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.info" returned: 0 in 0.282s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.454s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Acquiring lock "cinder-quobyte-d83eb5de-5d0a-4b3e-87c4-62d6509a86c5-fc47939b-7319-4373-819e-39ef697b8e83" by "_create_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Lock "cinder-quobyte-d83eb5de-5d0a-4b3e-87c4-62d6509a86c5-fc47939b-7319-4373-819e-39ef697b8e83" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Creating volume fc47939b-7319-4373-819e-39ef697b8e83 from snapshot d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 {{(pid=87582) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Acquiring lock "cinder-quobyte-fc47939b-7319-4373-819e-39ef697b8e83" by "_copy_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Lock "cinder-quobyte-fc47939b-7319-4373-819e-39ef697b8e83" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] snapshot: d83eb5de-5d0a-4b3e-87c4-62d6509a86c5, volume: fc47939b-7319-4373-819e-39ef697b8e83, {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:03 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-79ad3746-429a-45ba-8fb0-30377a0a54dc tempest-ProjectMemberTests-371943627 None] Create snapshot completed successfully Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1354bc-b579-4922-ab1d-24b23ff7c514]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:03 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 Sep 03 20:20:03 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:03 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5" returned: 0 in 0.395s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[834364c5-6293-4816-91fe-5c704fb056d9]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:03 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 Sep 03 20:20:03 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:03 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2" returned: 0 in 0.372s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Creating direct copy from snapshot {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG cinder.utils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Path /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83 not found in is_blk_device check {{(pid=87582) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 20:20:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:04 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83 Sep 03 20:20:04 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-82f53046-edd3-407e-8ede-e556ccafe648-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Lock "cinder-82f53046-edd3-407e-8ede-e556ccafe648-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-82f53046-edd3-407e-8ede-e556ccafe648" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-82f53046-edd3-407e-8ede-e556ccafe648" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Deleting offline snapshot 82f53046-edd3-407e-8ede-e556ccafe648 of volume 12a4f02b-bdf8-43b5-974d-0cf76b7ba34f {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] snapshot_file for this snap is: volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aca768-ee81-42c8-a690-0d42a27384c1]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:04 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 Sep 03 20:20:04 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Flow 'volume_create_manager' (45ad40b2-7923-41bf-9e25-a788ed4acc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e48ecc-4011-4087-abdc-99d3f29fce5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e48ecc-4011-4087-abdc-99d3f29fce5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2011596341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6ad4c4-dba6-44da-a7d7-044778fa2600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e376d64384c4263be18e00a286e19a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:04Z,use_quota=True,user_id='d2acef2403924a3ea082477a2fa5c149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (affd449b-5e45-47dc-bd1f-b92b79676e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (affd449b-5e45-47dc-bd1f-b92b79676e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5aba33d-4143-46c9-a248-4ea496137064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5aba33d-4143-46c9-a248-4ea496137064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6ad4c4-dba6-44da-a7d7-044778fa2600', 'volume_name': 'volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca6ef7e-669b-48e1-bbf5-cb857a94b604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca6ef7e-669b-48e1-bbf5-cb857a94b604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262c8f76-5b82-41a6-990f-e72b8a73a21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:04 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume 0c6ad4c4-dba6-44da-a7d7-044778fa2600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600', 'volume_size': 1} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:04 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648" returned: 0 in 0.611s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf079f7-b39b-4e8b-9008-3d10cbc1e5b1]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:05 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f Sep 03 20:20:05 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:05 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f" returned: 0 in 0.732s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:05 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 Sep 03 20:20:05 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:06 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648" returned: 0 in 0.698s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:06 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648 Sep 03 20:20:06 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:06 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f.82f53046-edd3-407e-8ede-e556ccafe648" returned: 0 in 0.532s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-82f53046-edd3-407e-8ede-e556ccafe648" released by "_delete_snapshot" :: held 2.774s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f" released by "delete_snapshot" :: held 2.810s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:07 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Created reservations ['2427965d-6503-4f8b-ab46-d7456bf43205', 'dda9b1c6-e7f2-4114-9117-aec75483be8c', '82623071-7fca-483d-b6dc-bb3ccb5b6ea2', '9fd9a5e8-f08f-4eab-b20c-b7c30a0e022a'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:07 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Delete snapshot completed successfully. Sep 03 20:20:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-caee0135-91fb-485a-886f-f58a6b47017a tempest-ProjectMemberTests-371943627 None] Lock "cinder-82f53046-edd3-407e-8ede-e556ccafe648-delete_snapshot" released by "delete_snapshot" :: held 3.112s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Lock "cinder-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f" acquired by "delete_volume" :: waited 0.046s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:07 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0961a19b-4c0c-4415-8b0f-40fa60403823]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:08 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f Sep 03 20:20:08 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:08 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f" returned: 0 in 0.880s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:08 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f Sep 03 20:20:08 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:08 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83" returned: 0 in 4.720s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:08 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2, size 1024.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:20:08 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Converted 1024.00 MB image at 216.81 MB/s Sep 03 20:20:08 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83 is being set with open permissions: ugo+rw Sep 03 20:20:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:08 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83 Sep 03 20:20:08 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:08 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f" returned: 0 in 0.251s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f" released by "delete_volume" :: held 1.291s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:08 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:08 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Created reservations ['c212c801-ec33-46c2-8982-f3795ca6250d', 'a31a1aad-25ce-4366-961e-46d347fb4ffc', '7d9aba14-3ff1-4095-820b-6d88e5f58e75', 'cad1990b-849e-4b5d-9c67-a8030c62e635'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83" returned: 0 in 0.274s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Lock "cinder-quobyte-fc47939b-7319-4373-819e-39ef697b8e83" released by "_copy_volume_from_snapshot" :: held 5.856s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Lock "cinder-quobyte-d83eb5de-5d0a-4b3e-87c4-62d6509a86c5-fc47939b-7319-4373-819e-39ef697b8e83" released by "_create_volume_from_snapshot" :: held 5.930s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.955s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.385s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-714761060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624fd3d8-665a-447a-8104-32d0d84a9f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc8eb4e85a7462287fc66bfa96c796d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:03Z,use_quota=True,user_id='53d3d1a77a2d4074b80f69c1f2a9dfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Creating volume 624fd3d8-665a-447a-8104-32d0d84a9f05 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:09 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:09 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05 1073741824 Sep 03 20:20:09 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:09 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:09 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12cbe56-69f1-4abb-baa0-ec9a7e1aa3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc47939b-7319-4373-819e-39ef697b8e83', 'volume_size': 1, 'snapshot_id': 'd83eb5de-5d0a-4b3e-87c4-62d6509a86c5'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6722c433-1fe2-4cde-9108-47a8e659ece8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:09 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Volume volume-fc47939b-7319-4373-819e-39ef697b8e83 (fc47939b-7319-4373-819e-39ef697b8e83): created successfully Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6722c433-1fe2-4cde-9108-47a8e659ece8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Flow 'volume_create_manager' (06bf05bc-69ee-4bdd-b49e-0354033413fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:09 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-94996011-d3e8-41ae-a2f9-ca0a57cef176 tempest-VolumeDependencyTests-294634065 None] Created volume successfully. Sep 03 20:20:09 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.251s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:09 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Deleted volume successfully. Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-35afa0f7-9618-4f55-9eed-6d8bb8eff7d9 tempest-ProjectMemberTests-371943627 None] Lock "cinder-12a4f02b-bdf8-43b5-974d-0cf76b7ba34f-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:09 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05 1073741824" returned: 0 in 0.440s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:09 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05 Sep 03 20:20:09 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:09 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05" returned: 0 in 0.243s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.214s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2011596341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6ad4c4-dba6-44da-a7d7-044778fa2600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e376d64384c4263be18e00a286e19a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:04Z,use_quota=True,user_id='d2acef2403924a3ea082477a2fa5c149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Creating volume 0c6ad4c4-dba6-44da-a7d7-044778fa2600 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:09 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38588404-fcd9-48d0-a160-418886894a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-624fd3d8-665a-447a-8104-32d0d84a9f05', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:09 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600 1073741824 Sep 03 20:20:09 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8b198d-cecc-48d8-a2b1-a229ded71b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:09 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Volume volume-624fd3d8-665a-447a-8104-32d0d84a9f05 (624fd3d8-665a-447a-8104-32d0d84a9f05): created successfully Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8b198d-cecc-48d8-a2b1-a229ded71b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Flow 'volume_create_manager' (d162bb20-76af-452c-a46a-bc62ffcf5296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:09 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8d28c2ea-2e47-49ed-b351-e4d5635f52e8 tempest-CinderUnicodeTest-817775336 None] Created volume successfully. Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Acquiring lock "cinder-d83eb5de-5d0a-4b3e-87c4-62d6509a86c5-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Lock "cinder-d83eb5de-5d0a-4b3e-87c4-62d6509a86c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Acquiring lock "cinder-quobyte-56859b7c-f32b-4743-a6ef-268f3af7fbe2" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:10 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600 1073741824" returned: 0 in 0.597s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Lock "cinder-quobyte-56859b7c-f32b-4743-a6ef-268f3af7fbe2" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Acquiring lock "cinder-quobyte-d83eb5de-5d0a-4b3e-87c4-62d6509a86c5" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (1bbfeffe-a33f-413b-a6c5-0caafe3a7b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14e8336-c109-4d1f-9c2d-86dbf2000f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Lock "cinder-quobyte-d83eb5de-5d0a-4b3e-87c4-62d6509a86c5" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Deleting offline snapshot d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 of volume 56859b7c-f32b-4743-a6ef-268f3af7fbe2 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] snapshot_file for this snap is: volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c06ba60-dd20-496d-a228-59e71ed0e708]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14e8336-c109-4d1f-9c2d-86dbf2000f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-610615186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931819e7-f450-4b71-9e88-f3c71ed07e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:10Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:10 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600 Sep 03 20:20:10 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f4725f-100a-40da-bafd-37e7141986ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f4725f-100a-40da-bafd-37e7141986ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026b2dbd-496a-4feb-b6e9-06b16bf1eb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026b2dbd-496a-4feb-b6e9-06b16bf1eb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '931819e7-f450-4b71-9e88-f3c71ed07e89', 'volume_name': 'volume-931819e7-f450-4b71-9e88-f3c71ed07e89', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea779b68-e90f-4574-aded-ccca9cdd10ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea779b68-e90f-4574-aded-ccca9cdd10ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c12f35-fc6c-43da-a41c-0a9024b02413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:10 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Volume 931819e7-f450-4b71-9e88-f3c71ed07e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-931819e7-f450-4b71-9e88-f3c71ed07e89', 'volume_size': 1} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:10 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 Sep 03 20:20:10 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:10 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600" returned: 0 in 0.250s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.201s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-610615186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931819e7-f450-4b71-9e88-f3c71ed07e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:10Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Creating volume 931819e7-f450-4b71-9e88-f3c71ed07e89 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:10 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262c8f76-5b82-41a6-990f-e72b8a73a21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:10 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89 1073741824 Sep 03 20:20:10 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c410a48f-90b4-4cff-961c-72abb6a0ab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:10 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600 (0c6ad4c4-dba6-44da-a7d7-044778fa2600): created successfully Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c410a48f-90b4-4cff-961c-72abb6a0ab1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Flow 'volume_create_manager' (45ad40b2-7923-41bf-9e25-a788ed4acc21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:10 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-44babf4d-0bb0-4659-9a3b-eeaf29d7da29 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Created volume successfully. Sep 03 20:20:10 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5" returned: 0 in 0.383s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c634634-ce3e-4e92-b826-fb34c5501d97]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:11 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 Sep 03 20:20:11 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:11 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89 1073741824" returned: 0 in 0.472s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:11 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89 Sep 03 20:20:11 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Flow 'volume_create_manager' (d6124b16-b922-44f8-b561-333b04a0a2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab88b72-1761-48c7-a52c-e7b1c30139bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:11 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab88b72-1761-48c7-a52c-e7b1c30139bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-285120926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa48c3df-c840-424c-a33e-667a629b7913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e376d64384c4263be18e00a286e19a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:11Z,use_quota=True,user_id='d2acef2403924a3ea082477a2fa5c149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9430ac1a-b810-4b85-a3e6-58560e8e6d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9430ac1a-b810-4b85-a3e6-58560e8e6d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcae3641-28b2-47fa-a63b-bbfa12ec20d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcae3641-28b2-47fa-a63b-bbfa12ec20d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa48c3df-c840-424c-a33e-667a629b7913', 'volume_name': 'volume-aa48c3df-c840-424c-a33e-667a629b7913', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d747914-1aca-43fa-ad36-3522cd113981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d747914-1aca-43fa-ad36-3522cd113981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2033dea8-25d9-4d88-b949-854f513e212f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:11 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume aa48c3df-c840-424c-a33e-667a629b7913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa48c3df-c840-424c-a33e-667a629b7913', 'volume_size': 1} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2" returned: 0 in 0.708s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:11 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 Sep 03 20:20:11 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:11 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89" returned: 0 in 0.385s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.131s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c12f35-fc6c-43da-a41c-0a9024b02413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-931819e7-f450-4b71-9e88-f3c71ed07e89', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f8a384-8179-40f3-b5a3-86d2e56c63c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] Creating offline snapshot fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f of volume 624fd3d8-665a-447a-8104-32d0d84a9f05 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:20:11 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Volume volume-931819e7-f450-4b71-9e88-f3c71ed07e89 (931819e7-f450-4b71-9e88-f3c71ed07e89): created successfully Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f8a384-8179-40f3-b5a3-86d2e56c63c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (1bbfeffe-a33f-413b-a6c5-0caafe3a7b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1391c289-6669-4d08-849e-ebf42ba33a8d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:11 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-dd0f59a0-715b-494d-a9e4-631aed9a799e tempest-ProjectMemberTests-371943627 None] Created volume successfully. Sep 03 20:20:11 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05 Sep 03 20:20:11 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Flow 'volume_create_manager' (4d09bf30-95e3-4420-8c28-273e8fd1b961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a34173-2a48-4687-967e-9bbbbafa56aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a34173-2a48-4687-967e-9bbbbafa56aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1063615117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9884e9c1-addc-48fc-a5c3-5913bd2d3bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e376d64384c4263be18e00a286e19a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:12Z,use_quota=True,user_id='d2acef2403924a3ea082477a2fa5c149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38434ad-04f6-41b9-89c0-fe6d356c3ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:11 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38434ad-04f6-41b9-89c0-fe6d356c3ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bebaeb2-bf22-4c1e-9075-f94d47771034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bebaeb2-bf22-4c1e-9075-f94d47771034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9884e9c1-addc-48fc-a5c3-5913bd2d3bbb', 'volume_name': 'volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c99f4d8-8cef-4c8b-a19c-f491617d22f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c99f4d8-8cef-4c8b-a19c-f491617d22f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7db506-86e7-4ef7-9b17-c2cc5392fef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:12 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume 9884e9c1-addc-48fc-a5c3-5913bd2d3bbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb', 'volume_size': 1} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:12 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5" returned: 0 in 0.451s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:12 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5 Sep 03 20:20:12 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:12 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05" returned: 0 in 0.456s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:12 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f 1G Sep 03 20:20:12 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Flow 'volume_create_manager' (0a7c79ac-2210-4932-91d5-e4f2090a7a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce32a89-da61-4ff0-86d5-62a3daea87d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce32a89-da61-4ff0-86d5-62a3daea87d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-694251383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183986dd-09f0-4138-a3fb-bb09fe127949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e376d64384c4263be18e00a286e19a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:12Z,use_quota=True,user_id='d2acef2403924a3ea082477a2fa5c149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f574ef5-e613-4709-be35-333bd0aaec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f574ef5-e613-4709-be35-333bd0aaec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56d7da5-bf33-4f6b-aab8-df1fed268d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56d7da5-bf33-4f6b-aab8-df1fed268d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '183986dd-09f0-4138-a3fb-bb09fe127949', 'volume_name': 'volume-183986dd-09f0-4138-a3fb-bb09fe127949', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc566f7-df39-4c9e-9051-f4df465d1c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc566f7-df39-4c9e-9051-f4df465d1c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de260df2-858f-4d6c-b044-6772e7b5c97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:12 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume 183986dd-09f0-4138-a3fb-bb09fe127949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-183986dd-09f0-4138-a3fb-bb09fe127949', 'volume_size': 1} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:12 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2.d83eb5de-5d0a-4b3e-87c4-62d6509a86c5" returned: 0 in 0.381s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Lock "cinder-quobyte-d83eb5de-5d0a-4b3e-87c4-62d6509a86c5" released by "_delete_snapshot" :: held 2.053s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Lock "cinder-quobyte-56859b7c-f32b-4743-a6ef-268f3af7fbe2" released by "delete_snapshot" :: held 2.132s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Created reservations ['fbd181db-60c6-447d-9687-695c2d6b8ecc', 'ff5cfd91-010e-414d-a0e0-15a4a7d21787', '350effc0-9edf-40f8-a605-69aad2320883', '53318081-ed9a-4243-9b1d-0d49cd7613ea'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:12 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Delete snapshot completed successfully. Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-0bd400d4-9f44-46a5-8b41-00441bd56e1e tempest-VolumeDependencyTests-294634065 None] Lock "cinder-d83eb5de-5d0a-4b3e-87c4-62d6509a86c5-delete_snapshot" released by "delete_snapshot" :: held 2.516s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Flow 'volume_create_manager' (a851a057-d172-49ed-9b98-bdf65ac68056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55e52eb-9e05-4415-9326-7460a3524d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55e52eb-9e05-4415-9326-7460a3524d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60204308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e772ba9f-8b53-4dcc-956a-a12f7da06b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e376d64384c4263be18e00a286e19a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:13Z,use_quota=True,user_id='d2acef2403924a3ea082477a2fa5c149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:12 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9ea631-5118-4053-bfe4-e80582ac1a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9ea631-5118-4053-bfe4-e80582ac1a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4cb09f-923b-4a80-8bfc-8497356a6b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4cb09f-923b-4a80-8bfc-8497356a6b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e772ba9f-8b53-4dcc-956a-a12f7da06b51', 'volume_name': 'volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f53756-cacf-490a-8f41-757043212357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f53756-cacf-490a-8f41-757043212357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82843fe6-4b28-4537-b44a-9c5d78108d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:12 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume e772ba9f-8b53-4dcc-956a-a12f7da06b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51', 'volume_size': 1} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f 1G" returned: 0 in 0.732s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624fd3d8-665a-447a-8104-32d0d84a9f05 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:13 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624fd3d8-665a-447a-8104-32d0d84a9f05 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f Sep 03 20:20:13 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Flow 'volume_create_manager' (32e40571-86a3-4c21-b19f-c97dc95e2507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b49698d-79a4-42d7-be75-d8a1f85ee53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b49698d-79a4-42d7-be75-d8a1f85ee53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1406190543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4057bbc6-98cb-4133-83fa-1100ce2f686e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e376d64384c4263be18e00a286e19a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:13Z,use_quota=True,user_id='d2acef2403924a3ea082477a2fa5c149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f3465a-931b-4e0f-8672-08ce18908673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f3465a-931b-4e0f-8672-08ce18908673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27bd83e-d667-41d8-9bda-649153a72b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27bd83e-d667-41d8-9bda-649153a72b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4057bbc6-98cb-4133-83fa-1100ce2f686e', 'volume_name': 'volume-4057bbc6-98cb-4133-83fa-1100ce2f686e', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f134bd-db85-48bb-9550-703b1b84a2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f134bd-db85-48bb-9550-703b1b84a2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df548247-8141-47a4-b0ed-560c18312851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:13 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume 4057bbc6-98cb-4133-83fa-1100ce2f686e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4057bbc6-98cb-4133-83fa-1100ce2f686e', 'volume_size': 1} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:13 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624fd3d8-665a-447a-8104-32d0d84a9f05 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f" returned: 0 in 0.299s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:13 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f is being set with open permissions: ugo+rw Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:13 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f Sep 03 20:20:13 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Acquiring lock "cinder-56859b7c-f32b-4743-a6ef-268f3af7fbe2-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:13 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f" returned: 0 in 0.259s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Lock "cinder-56859b7c-f32b-4743-a6ef-268f3af7fbe2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Acquiring lock "cinder-quobyte-56859b7c-f32b-4743-a6ef-268f3af7fbe2" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:13 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.info Sep 03 20:20:13 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Lock "cinder-quobyte-56859b7c-f32b-4743-a6ef-268f3af7fbe2" acquired by "delete_volume" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[475c7174-e4d6-4c36-8747-d84f98f690be]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:13 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 Sep 03 20:20:13 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:13 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.info" returned: 0 in 0.313s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:13 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.info is being set with open permissions: ugo+rw Sep 03 20:20:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:13 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.info Sep 03 20:20:13 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:14 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2" returned: 0 in 0.424s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:14 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2 Sep 03 20:20:14 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:14 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.info" returned: 0 in 0.264s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.581s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-285120926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa48c3df-c840-424c-a33e-667a629b7913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e376d64384c4263be18e00a286e19a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:11Z,use_quota=True,user_id='d2acef2403924a3ea082477a2fa5c149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Creating volume aa48c3df-c840-424c-a33e-667a629b7913 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:14 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa48c3df-c840-424c-a33e-667a629b7913 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:14 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa48c3df-c840-424c-a33e-667a629b7913 1073741824 Sep 03 20:20:14 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:14 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ee5c9c84-4b7e-4ac4-bc39-2b6ab5cf180b tempest-CinderUnicodeTest-817775336 None] Create snapshot completed successfully Sep 03 20:20:14 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-56859b7c-f32b-4743-a6ef-268f3af7fbe2" returned: 0 in 0.260s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Lock "cinder-quobyte-56859b7c-f32b-4743-a6ef-268f3af7fbe2" released by "delete_volume" :: held 0.746s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Created reservations ['6e5771cc-863e-4b08-b081-9f4c0fb90f2a', 'c6025a6e-1af7-49dd-931b-8912c9993bd9', '178d99d9-e3e8-4e75-954d-75adc5ee123c', '3b316571-b3dd-44b3-8cc6-3d16ab4bab14'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:14 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:14 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:14 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Acquiring lock "cinder-fc47939b-7319-4373-819e-39ef697b8e83-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa48c3df-c840-424c-a33e-667a629b7913 1073741824" returned: 0 in 0.513s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Lock "cinder-fc47939b-7319-4373-819e-39ef697b8e83-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:14 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.277s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:14 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Deleted volume successfully. Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa48c3df-c840-424c-a33e-667a629b7913 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-6077f74b-6409-4357-a792-fd84ec19a99b tempest-VolumeDependencyTests-294634065 None] Lock "cinder-56859b7c-f32b-4743-a6ef-268f3af7fbe2-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:14 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa48c3df-c840-424c-a33e-667a629b7913 Sep 03 20:20:14 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Acquiring lock "cinder-quobyte-fc47939b-7319-4373-819e-39ef697b8e83" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Lock "cinder-quobyte-fc47939b-7319-4373-819e-39ef697b8e83" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78b45ce-3ce4-42a2-b8f5-013e60f41c29]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Acquiring lock "cinder-fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Lock "cinder-fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Acquiring lock "cinder-quobyte-624fd3d8-665a-447a-8104-32d0d84a9f05" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Lock "cinder-quobyte-624fd3d8-665a-447a-8104-32d0d84a9f05" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Acquiring lock "cinder-quobyte-fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Lock "cinder-quobyte-fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Deleting offline snapshot fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f of volume 624fd3d8-665a-447a-8104-32d0d84a9f05 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:20:15 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83 Sep 03 20:20:15 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] snapshot_file for this snap is: volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d818abe-a6c5-41c1-9e20-86a019fc3b21]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:15 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa48c3df-c840-424c-a33e-667a629b7913" returned: 0 in 0.336s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.122s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1063615117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9884e9c1-addc-48fc-a5c3-5913bd2d3bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e376d64384c4263be18e00a286e19a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:12Z,use_quota=True,user_id='d2acef2403924a3ea082477a2fa5c149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Creating volume 9884e9c1-addc-48fc-a5c3-5913bd2d3bbb {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:15 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:15 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f Sep 03 20:20:15 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2033dea8-25d9-4d88-b949-854f513e212f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa48c3df-c840-424c-a33e-667a629b7913', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:15 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb 1073741824 Sep 03 20:20:15 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c881746-4922-4e4b-8219-2ece29b56836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:15 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume volume-aa48c3df-c840-424c-a33e-667a629b7913 (aa48c3df-c840-424c-a33e-667a629b7913): created successfully Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c881746-4922-4e4b-8219-2ece29b56836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Flow 'volume_create_manager' (d6124b16-b922-44f8-b561-333b04a0a2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:15 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-36804bb6-5a9b-4a20-9b37-f08a7d7064d0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Created volume successfully. Sep 03 20:20:15 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83" returned: 0 in 0.426s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:15 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83 Sep 03 20:20:15 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:15 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f" returned: 0 in 0.411s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-624fd3d8-665a-447a-8104-32d0d84a9f05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaeb855-7e9f-4d3e-9790-727715ff3d50]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:15 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-fc47939b-7319-4373-819e-39ef697b8e83" returned: 0 in 0.262s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Lock "cinder-quobyte-fc47939b-7319-4373-819e-39ef697b8e83" released by "delete_volume" :: held 0.738s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:15 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05 Sep 03 20:20:15 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:15 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb 1073741824" returned: 0 in 0.487s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Created reservations ['5209ac17-ea0f-47bd-a9ca-c112b54f8133', 'f0ff1483-6cac-4158-9d2b-68d850412d50', '967da9cb-ef75-4b04-ba29-f66119888c4a', '63aad107-0bfd-4d76-81cd-cac4250ea259'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:15 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb Sep 03 20:20:15 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:15 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:15 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:15 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05" returned: 0 in 0.425s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:15 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f Sep 03 20:20:15 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:15 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb" returned: 0 in 0.297s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.559s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-694251383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183986dd-09f0-4138-a3fb-bb09fe127949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e376d64384c4263be18e00a286e19a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:12Z,use_quota=True,user_id='d2acef2403924a3ea082477a2fa5c149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Creating volume 183986dd-09f0-4138-a3fb-bb09fe127949 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:16 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-183986dd-09f0-4138-a3fb-bb09fe127949 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:16 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.283s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:16 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-183986dd-09f0-4138-a3fb-bb09fe127949 1073741824 Sep 03 20:20:16 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7db506-86e7-4ef7-9b17-c2cc5392fef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4148562c-f10e-437a-a690-ce286499161e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:16 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Deleted volume successfully. Sep 03 20:20:16 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb (9884e9c1-addc-48fc-a5c3-5913bd2d3bbb): created successfully Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4148562c-f10e-437a-a690-ce286499161e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Flow 'volume_create_manager' (4d09bf30-95e3-4420-8c28-273e8fd1b961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:16 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f88005d0-eab1-43e0-be33-ea50e5b87db8 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Created volume successfully. Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-423c1229-3f3a-4937-8f80-b2a7f017a77b tempest-VolumeDependencyTests-294634065 None] Lock "cinder-fc47939b-7319-4373-819e-39ef697b8e83-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:16 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f" returned: 0 in 0.461s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:16 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f Sep 03 20:20:16 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:16 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-183986dd-09f0-4138-a3fb-bb09fe127949 1073741824" returned: 0 in 0.581s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-183986dd-09f0-4138-a3fb-bb09fe127949 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:16 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-183986dd-09f0-4138-a3fb-bb09fe127949 Sep 03 20:20:16 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:16 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05.fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f" returned: 0 in 0.293s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Lock "cinder-quobyte-fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f" released by "_delete_snapshot" :: held 1.704s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Lock "cinder-quobyte-624fd3d8-665a-447a-8104-32d0d84a9f05" released by "delete_snapshot" :: held 1.732s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Created reservations ['bfa6681d-3ebd-4bb0-ad15-585bf97a39f9', '340268d6-59a0-424c-bd7e-e0df5bc866c7', '27f4130e-8b3e-4879-9b4e-281b614b5298', 'bd2cc6e4-0496-4dcb-8e7e-88c219a8c7c7'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:16 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Delete snapshot completed successfully. Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-33b9e38b-431b-4a13-8ae0-ff2684dd0371 tempest-CinderUnicodeTest-817775336 None] Lock "cinder-fbec1a01-a48d-43ee-bab4-c58ff5bf4b2f-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:16 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-183986dd-09f0-4138-a3fb-bb09fe127949" returned: 0 in 0.292s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.938s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60204308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e772ba9f-8b53-4dcc-956a-a12f7da06b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e376d64384c4263be18e00a286e19a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:13Z,use_quota=True,user_id='d2acef2403924a3ea082477a2fa5c149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Creating volume e772ba9f-8b53-4dcc-956a-a12f7da06b51 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:16 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de260df2-858f-4d6c-b044-6772e7b5c97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-183986dd-09f0-4138-a3fb-bb09fe127949', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178ab768-5567-47bd-817e-16b1fb546d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:16 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51 1073741824 Sep 03 20:20:16 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:16 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume volume-183986dd-09f0-4138-a3fb-bb09fe127949 (183986dd-09f0-4138-a3fb-bb09fe127949): created successfully Sep 03 20:20:16 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178ab768-5567-47bd-817e-16b1fb546d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Flow 'volume_create_manager' (0a7c79ac-2210-4932-91d5-e4f2090a7a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:17 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b430c336-7d7a-4bde-803f-061eb6a4b486 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Created volume successfully. Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Acquiring lock "cinder-624fd3d8-665a-447a-8104-32d0d84a9f05-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Lock "cinder-624fd3d8-665a-447a-8104-32d0d84a9f05-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Acquiring lock "cinder-quobyte-624fd3d8-665a-447a-8104-32d0d84a9f05" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Lock "cinder-quobyte-624fd3d8-665a-447a-8104-32d0d84a9f05" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9bd426-2191-4a01-91bf-4217b43e04f6]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:17 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51 1073741824" returned: 0 in 0.526s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:17 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05 Sep 03 20:20:17 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:17 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51 Sep 03 20:20:17 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:17 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51" returned: 0 in 0.304s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.825s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82843fe6-4b28-4537-b44a-9c5d78108d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f547ee-66df-4830-a053-6ade4936abb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] Creating offline snapshot 32b43e12-a7cf-4d15-be48-1113c2bbf19f of volume 931819e7-f450-4b71-9e88-f3c71ed07e89 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:20:17 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51 (e772ba9f-8b53-4dcc-956a-a12f7da06b51): created successfully Sep 03 20:20:17 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f547ee-66df-4830-a053-6ade4936abb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Flow 'volume_create_manager' (a851a057-d172-49ed-9b98-bdf65ac68056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05" returned: 0 in 0.558s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[572a1423-c0b0-4529-91cf-1ac471428f33]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:17 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-dec3aace-ff3b-4ef9-b253-0d3986af587c tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Created volume successfully. Sep 03 20:20:17 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05 Sep 03 20:20:17 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:18 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89 Sep 03 20:20:18 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:18 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-624fd3d8-665a-447a-8104-32d0d84a9f05" returned: 0 in 0.278s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Lock "cinder-quobyte-624fd3d8-665a-447a-8104-32d0d84a9f05" released by "delete_volume" :: held 0.904s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Created reservations ['7c3dac6f-dd0d-4519-965f-563a3b0148a0', 'ba977633-756d-41f2-85ec-ee35cfd3ec63', '2c406485-fe25-4e5d-a497-da16e36bf08f', '7a1c939e-673d-4c6b-acfc-240d31a3c856'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:18 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89" returned: 0 in 0.474s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:18 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:18 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:18 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f 1G Sep 03 20:20:18 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:18 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.281s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:18 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Deleted volume successfully. Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3e9b5d7c-43ec-47a0-a56f-9bd1d548310d tempest-CinderUnicodeTest-817775336 None] Lock "cinder-624fd3d8-665a-447a-8104-32d0d84a9f05-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:18 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f 1G" returned: 0 in 0.507s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-931819e7-f450-4b71-9e88-f3c71ed07e89 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:18 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-931819e7-f450-4b71-9e88-f3c71ed07e89 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f Sep 03 20:20:18 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:19 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-931819e7-f450-4b71-9e88-f3c71ed07e89 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f" returned: 0 in 0.311s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:19 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f is being set with open permissions: ugo+rw Sep 03 20:20:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:19 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f Sep 03 20:20:19 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Acquiring lock "cinder-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:19 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Lock "cinder-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f" returned: 0 in 0.262s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Acquiring lock "cinder-quobyte-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:19 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.info Sep 03 20:20:19 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Lock "cinder-quobyte-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9" acquired by "delete_volume" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:19 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9ba945-e1be-4347-b84d-5ce7208c7548]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:19 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9 Sep 03 20:20:19 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:19 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-c40ac632-c9a6-4d9e-ba7e-32d0ddf1272d tempest-ProjectAdminTests-793479588 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8243980407715, 'free_capacity_gb': 1773.8243980407715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87582) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 20:20:19 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.info" returned: 0 in 0.299s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:19 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.info is being set with open permissions: ugo+rw Sep 03 20:20:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:19 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.info Sep 03 20:20:19 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:20 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9" returned: 0 in 0.439s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:20 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9 Sep 03 20:20:20 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:20 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.info" returned: 0 in 0.283s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.894s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1406190543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4057bbc6-98cb-4133-83fa-1100ce2f686e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e376d64384c4263be18e00a286e19a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:13Z,use_quota=True,user_id='d2acef2403924a3ea082477a2fa5c149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Creating volume 4057bbc6-98cb-4133-83fa-1100ce2f686e {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:20 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4057bbc6-98cb-4133-83fa-1100ce2f686e 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:20 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4057bbc6-98cb-4133-83fa-1100ce2f686e 1073741824 Sep 03 20:20:20 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:20 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b93da0bc-4a0a-495e-91f2-ac213cfcaaac tempest-ProjectMemberTests-371943627 None] Create snapshot completed successfully Sep 03 20:20:20 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9" returned: 0 in 0.289s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Lock "cinder-quobyte-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9" released by "delete_volume" :: held 0.774s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Created reservations ['ecbfb8f0-a629-46e8-890d-7525b94ab030', '0a38eebb-8806-4cd8-adcf-624dbb9b2e5c', 'e4367791-1173-4ad8-aa62-3812406888dd', 'ecc2823a-f802-42ca-a354-3b0edb9944bf'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:20 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:20 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:20 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4057bbc6-98cb-4133-83fa-1100ce2f686e 1073741824" returned: 0 in 0.592s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4057bbc6-98cb-4133-83fa-1100ce2f686e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:20 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.342s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:20 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Deleted volume successfully. Sep 03 20:20:20 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4057bbc6-98cb-4133-83fa-1100ce2f686e Sep 03 20:20:20 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5d1dff97-288a-44f0-a839-a6c9165185a8 tempest-CinderUnicodeTest-817775336 None] Lock "cinder-57b1ab1c-7a2f-4df4-8c9d-7178e8071ab9-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:21 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4057bbc6-98cb-4133-83fa-1100ce2f686e" returned: 0 in 0.356s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df548247-8141-47a4-b0ed-560c18312851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4057bbc6-98cb-4133-83fa-1100ce2f686e', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cab75e0-a016-46ec-9241-206b8c9b951e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:21 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Volume volume-4057bbc6-98cb-4133-83fa-1100ce2f686e (4057bbc6-98cb-4133-83fa-1100ce2f686e): created successfully Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cab75e0-a016-46ec-9241-206b8c9b951e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Flow 'volume_create_manager' (32e40571-86a3-4c21-b19f-c97dc95e2507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-32b43e12-a7cf-4d15-be48-1113c2bbf19f-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:21 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-cb6d99fb-feb2-401c-a919-ac6cac40ee83 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Created volume successfully. Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Lock "cinder-32b43e12-a7cf-4d15-be48-1113c2bbf19f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-931819e7-f450-4b71-9e88-f3c71ed07e89" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-931819e7-f450-4b71-9e88-f3c71ed07e89" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-32b43e12-a7cf-4d15-be48-1113c2bbf19f" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-32b43e12-a7cf-4d15-be48-1113c2bbf19f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Deleting offline snapshot 32b43e12-a7cf-4d15-be48-1113c2bbf19f of volume 931819e7-f450-4b71-9e88-f3c71ed07e89 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] snapshot_file for this snap is: volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0140335-7544-4f55-8fd7-84c6d6b2c537]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:21 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f Sep 03 20:20:21 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:21 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f" returned: 0 in 0.458s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-931819e7-f450-4b71-9e88-f3c71ed07e89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5760fb8-2ad5-4ddb-aa7d-c1abedfa7e18]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:21 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89 Sep 03 20:20:21 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "cinder-4057bbc6-98cb-4133-83fa-1100ce2f686e-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-4057bbc6-98cb-4133-83fa-1100ce2f686e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "cinder-quobyte-4057bbc6-98cb-4133-83fa-1100ce2f686e" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:22 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:22 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-quobyte-4057bbc6-98cb-4133-83fa-1100ce2f686e" acquired by "delete_volume" :: waited 0.037s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89" returned: 0 in 0.495s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:22 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b792c17-9218-488c-be4a-71990ae0edf8]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4057bbc6-98cb-4133-83fa-1100ce2f686e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:22 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f Sep 03 20:20:22 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:22 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4057bbc6-98cb-4133-83fa-1100ce2f686e Sep 03 20:20:22 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:22 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f" returned: 0 in 0.592s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:23 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f Sep 03 20:20:23 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:23 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4057bbc6-98cb-4133-83fa-1100ce2f686e" returned: 0 in 0.611s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4057bbc6-98cb-4133-83fa-1100ce2f686e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:23 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4057bbc6-98cb-4133-83fa-1100ce2f686e Sep 03 20:20:23 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:23 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89.32b43e12-a7cf-4d15-be48-1113c2bbf19f" returned: 0 in 0.299s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-32b43e12-a7cf-4d15-be48-1113c2bbf19f" released by "_delete_snapshot" :: held 2.000s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-931819e7-f450-4b71-9e88-f3c71ed07e89" released by "delete_snapshot" :: held 2.050s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:23 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-4057bbc6-98cb-4133-83fa-1100ce2f686e" returned: 0 in 0.380s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-quobyte-4057bbc6-98cb-4133-83fa-1100ce2f686e" released by "delete_volume" :: held 1.101s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Created reservations ['d6fbb1c7-36a9-4d27-a783-68ad3160bf58', '66e6c802-b4f9-4f9e-b513-b57cb9393621', 'ce4a0c93-a79d-4b0c-b7c2-48e4bd88bd2e', '4f40491e-95d7-41cd-adce-405df37ba81b'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Created reservations ['e47f7d74-5da3-48aa-9258-ab9905f65f27', '900bcb54-990d-400f-9a6b-20d64629c7d8', 'b65acae5-22a6-497f-9ab5-0d975fd1bb7d', '36e433d6-f33f-4b81-904f-4da83d5408ed'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Delete snapshot completed successfully. Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-edad563b-9994-4529-8625-e5e1fd877bd3 tempest-ProjectMemberTests-371943627 None] Lock "cinder-32b43e12-a7cf-4d15-be48-1113c2bbf19f-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:23 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:23 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:23 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.285s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Deleted volume successfully. Sep 03 20:20:23 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-7387f804-637a-4d65-a9b0-1a71a799e1a0 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-4057bbc6-98cb-4133-83fa-1100ce2f686e-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "cinder-e772ba9f-8b53-4dcc-956a-a12f7da06b51-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-e772ba9f-8b53-4dcc-956a-a12f7da06b51-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-931819e7-f450-4b71-9e88-f3c71ed07e89-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "cinder-quobyte-e772ba9f-8b53-4dcc-956a-a12f7da06b51" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Lock "cinder-931819e7-f450-4b71-9e88-f3c71ed07e89-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-quobyte-e772ba9f-8b53-4dcc-956a-a12f7da06b51" acquired by "delete_volume" :: waited 0.048s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:24 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2423f659-9fcc-4ef4-9719-6e8ff63c1f25]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-931819e7-f450-4b71-9e88-f3c71ed07e89" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-931819e7-f450-4b71-9e88-f3c71ed07e89" acquired by "delete_volume" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:24 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3856c5-11ff-4915-85c8-cbf1afcad047]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:24 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51 Sep 03 20:20:24 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:24 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89 Sep 03 20:20:24 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:25 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51" returned: 0 in 0.535s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:25 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51 Sep 03 20:20:25 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:25 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89" returned: 0 in 0.479s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:25 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89 Sep 03 20:20:25 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:25 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e772ba9f-8b53-4dcc-956a-a12f7da06b51" returned: 0 in 0.327s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-quobyte-e772ba9f-8b53-4dcc-956a-a12f7da06b51" released by "delete_volume" :: held 0.939s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:25 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-931819e7-f450-4b71-9e88-f3c71ed07e89" returned: 0 in 0.287s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-931819e7-f450-4b71-9e88-f3c71ed07e89" released by "delete_volume" :: held 0.865s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Created reservations ['85b7a858-d226-4702-be9a-d227ef430843', 'a5647031-c902-4441-89f7-1763f07e3c0b', '12abe1c4-68ec-4679-aa15-7c69b2aad053', '41d2a60b-c22a-4f0a-a354-4f302aa11c96'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Created reservations ['f1adf847-f544-4947-b9ad-201f67915038', 'ed4725d9-3d00-459a-bb27-3aa67e66fc27', '04cca47e-9c49-4402-ba2c-c0edbbe0c005', 'a2c484c5-a08b-40b0-8e3c-11e0b02af429'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:25 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:25 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:25 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:25 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:26 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.310s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:26 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:26 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Deleted volume successfully. Sep 03 20:20:26 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.296s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:26 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-ee0ff91e-5a81-43c3-8639-5cc9bb85b605 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-e772ba9f-8b53-4dcc-956a-a12f7da06b51-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:26 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Deleted volume successfully. Sep 03 20:20:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82a2b335-358c-4bfb-bdfe-297e3d16bc89 tempest-ProjectMemberTests-371943627 None] Lock "cinder-931819e7-f450-4b71-9e88-f3c71ed07e89-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "cinder-183986dd-09f0-4138-a3fb-bb09fe127949-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-183986dd-09f0-4138-a3fb-bb09fe127949-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "cinder-quobyte-183986dd-09f0-4138-a3fb-bb09fe127949" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-quobyte-183986dd-09f0-4138-a3fb-bb09fe127949" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c3cad8-d05f-4338-b95e-15c0eebbdb3b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-183986dd-09f0-4138-a3fb-bb09fe127949 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:27 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-183986dd-09f0-4138-a3fb-bb09fe127949 Sep 03 20:20:27 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:27 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-183986dd-09f0-4138-a3fb-bb09fe127949" returned: 0 in 0.462s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-183986dd-09f0-4138-a3fb-bb09fe127949 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:27 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-183986dd-09f0-4138-a3fb-bb09fe127949 Sep 03 20:20:27 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (3c5dfd25-0ff0-4e6d-916e-c311e842d0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8339ec84-62bc-48da-bcf2-e224c2d274e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8339ec84-62bc-48da-bcf2-e224c2d274e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096257040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6427881c-212c-4c4c-be4a-abfcecc17e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:28Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e984a832-c6e8-4a1b-b408-d2896d4cd20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e984a832-c6e8-4a1b-b408-d2896d4cd20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03fbcbe-fedb-4244-af02-2ec859b385b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03fbcbe-fedb-4244-af02-2ec859b385b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6427881c-212c-4c4c-be4a-abfcecc17e9e', 'volume_name': 'volume-6427881c-212c-4c4c-be4a-abfcecc17e9e', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71772fa-1e43-4b8c-86e1-f54cee8717e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71772fa-1e43-4b8c-86e1-f54cee8717e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84154d24-3925-4d4f-8884-015729e848c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:27 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Volume 6427881c-212c-4c4c-be4a-abfcecc17e9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6427881c-212c-4c4c-be4a-abfcecc17e9e', 'volume_size': 1} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096257040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6427881c-212c-4c4c-be4a-abfcecc17e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:28Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Creating volume 6427881c-212c-4c4c-be4a-abfcecc17e9e {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:27 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:27 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e 1073741824 Sep 03 20:20:27 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:27 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-183986dd-09f0-4138-a3fb-bb09fe127949" returned: 0 in 0.359s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-quobyte-183986dd-09f0-4138-a3fb-bb09fe127949" released by "delete_volume" :: held 0.886s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=208,cinder:UPDATE=291,cinder:INSERT=72,cinder:DELETE=25 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:20:27 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Created reservations ['93343ec9-b1d4-45f7-ba04-c1f326787f88', '18158fe0-6fa2-4fa9-83b2-54e7177f2995', '9d160090-e263-4dc5-99ac-f1dd9d44b07f', '272ae267-9319-44d0-86c0-831fae09a93f'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:UPDATE=278,cinder:SELECT=228,cinder:INSERT=82,cinder:DELETE=26 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:28 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:28 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "cinder-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "cinder-quobyte-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-quobyte-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb" acquired by "delete_volume" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:28 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e 1073741824" returned: 0 in 0.609s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[66644a46-d4b4-4d62-801c-23d16dcbd5df]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:28 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e Sep 03 20:20:28 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:28 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb Sep 03 20:20:28 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:28 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.454s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:28 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Deleted volume successfully. Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-540ac5b2-1bb6-4998-bfe0-17d83d498789 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-183986dd-09f0-4138-a3fb-bb09fe127949-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:28 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e" returned: 0 in 0.412s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84154d24-3925-4d4f-8884-015729e848c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6427881c-212c-4c4c-be4a-abfcecc17e9e', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86395fa0-d8d2-4842-8fb9-016b07334a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:28 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb" returned: 0 in 0.498s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:28 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Volume volume-6427881c-212c-4c4c-be4a-abfcecc17e9e (6427881c-212c-4c4c-be4a-abfcecc17e9e): created successfully Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86395fa0-d8d2-4842-8fb9-016b07334a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:28 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb Sep 03 20:20:28 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (3c5dfd25-0ff0-4e6d-916e-c311e842d0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:28 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-3ef51c9a-abe6-4841-815e-abb73c88725a tempest-ProjectMemberTests-371943627 None] Created volume successfully. Sep 03 20:20:29 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb" returned: 0 in 0.282s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-quobyte-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb" released by "delete_volume" :: held 0.842s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Created reservations ['fd9f4640-d7ad-4ca7-a143-3d5de89c0cff', '5af9f1d7-b032-4f04-a346-1dd8df4d658a', 'd2cf39cb-0419-4a6b-a493-ee02438c7d35', '52c361ff-6334-4cc5-ae86-e516fd18149f'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:29 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:29 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "cinder-aa48c3df-c840-424c-a33e-667a629b7913-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-aa48c3df-c840-424c-a33e-667a629b7913-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "cinder-quobyte-aa48c3df-c840-424c-a33e-667a629b7913" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-quobyte-aa48c3df-c840-424c-a33e-667a629b7913" acquired by "delete_volume" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf4f7c-daaa-4c03-bdce-37471d841b16]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa48c3df-c840-424c-a33e-667a629b7913 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:29 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.345s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:29 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Deleted volume successfully. Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3e0d1baf-64f3-446a-bb31-9fd5b1acaad9 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-9884e9c1-addc-48fc-a5c3-5913bd2d3bbb-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:29 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa48c3df-c840-424c-a33e-667a629b7913 Sep 03 20:20:29 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] Creating offline snapshot 5f7337af-17c9-4162-a8fe-c9569095324e of volume 6427881c-212c-4c4c-be4a-abfcecc17e9e {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0ef73d-2090-47fa-80a9-daf6aa4397b4]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:30 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa48c3df-c840-424c-a33e-667a629b7913" returned: 0 in 0.528s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa48c3df-c840-424c-a33e-667a629b7913 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:30 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa48c3df-c840-424c-a33e-667a629b7913 Sep 03 20:20:30 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:30 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e Sep 03 20:20:30 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:30 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e" returned: 0 in 0.483s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:30 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-aa48c3df-c840-424c-a33e-667a629b7913" returned: 0 in 0.428s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:30 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e 1G Sep 03 20:20:30 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-quobyte-aa48c3df-c840-424c-a33e-667a629b7913" released by "delete_volume" :: held 1.023s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Created reservations ['a7910281-6678-49f0-98c8-4ef790a33214', '2edd3e33-e0b4-4f32-afa5-d6c3685cc508', 'fb70c8e6-5fb0-4be7-9800-51256dcb5fb8', 'bf20b2c7-a1db-4687-8874-32d81b0d92af'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:30 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:30 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:30 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.272s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:30 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:30 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Deleted volume successfully. Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e 1G" returned: 0 in 0.490s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6427881c-212c-4c4c-be4a-abfcecc17e9e -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-88e673f7-3ff4-4303-9c3f-b51c2fd24ccd tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-aa48c3df-c840-424c-a33e-667a629b7913-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:31 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6427881c-212c-4c4c-be4a-abfcecc17e9e -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e Sep 03 20:20:31 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:31 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6427881c-212c-4c4c-be4a-abfcecc17e9e -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e" returned: 0 in 0.289s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:31 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e is being set with open permissions: ugo+rw Sep 03 20:20:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:31 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e Sep 03 20:20:31 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:31 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e" returned: 0 in 0.269s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:31 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.info Sep 03 20:20:31 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "cinder-0c6ad4c4-dba6-44da-a7d7-044778fa2600-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-0c6ad4c4-dba6-44da-a7d7-044778fa2600-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "cinder-quobyte-0c6ad4c4-dba6-44da-a7d7-044778fa2600" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:31 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-quobyte-0c6ad4c4-dba6-44da-a7d7-044778fa2600" acquired by "delete_volume" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:31 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c117e2c3-800d-416d-8705-35891100d2a7]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:31 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.info" returned: 0 in 0.320s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:31 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.info is being set with open permissions: ugo+rw Sep 03 20:20:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:31 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.info Sep 03 20:20:31 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:31 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600 Sep 03 20:20:31 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:32 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.info" returned: 0 in 0.285s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.227s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:32 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2bc0fbb7-3739-4ad3-8a55-8d8c4a0890f0 tempest-ProjectMemberTests-371943627 None] Create snapshot completed successfully Sep 03 20:20:32 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600" returned: 0 in 0.423s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:32 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600 Sep 03 20:20:32 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:32 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0c6ad4c4-dba6-44da-a7d7-044778fa2600" returned: 0 in 0.264s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-quobyte-0c6ad4c4-dba6-44da-a7d7-044778fa2600" released by "delete_volume" :: held 0.740s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Created reservations ['98197398-0339-4f61-af9b-085627c1408a', '50a0409e-9e36-4130-8f01-1d82a413fcb2', 'aa1cec0c-b501-4f4c-a58f-a665577d0c0b', '954ccf00-3709-4351-94f9-50f15a58a2cb'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:32 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:32 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:32 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.271s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:32 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Deleted volume successfully. Sep 03 20:20:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-23da2fab-3bd4-40e3-8eef-c70ca0d5f872 tempest-CreateVolumesFromSourceVolumeTest-1988119826 None] Lock "cinder-0c6ad4c4-dba6-44da-a7d7-044778fa2600-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-5f7337af-17c9-4162-a8fe-c9569095324e-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Lock "cinder-5f7337af-17c9-4162-a8fe-c9569095324e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-6427881c-212c-4c4c-be4a-abfcecc17e9e" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-6427881c-212c-4c4c-be4a-abfcecc17e9e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-5f7337af-17c9-4162-a8fe-c9569095324e" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-5f7337af-17c9-4162-a8fe-c9569095324e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Deleting offline snapshot 5f7337af-17c9-4162-a8fe-c9569095324e of volume 6427881c-212c-4c4c-be4a-abfcecc17e9e {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] snapshot_file for this snap is: volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2fcbae-99be-4d82-ad69-8a6307c25cac]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:33 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e Sep 03 20:20:33 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:33 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e" returned: 0 in 0.448s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6427881c-212c-4c4c-be4a-abfcecc17e9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a84618-2b94-4d26-ad61-41b925f12d26]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:33 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e Sep 03 20:20:33 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:34 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e" returned: 0 in 0.442s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:34 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e Sep 03 20:20:34 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:34 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e" returned: 0 in 0.430s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:34 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e Sep 03 20:20:34 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:34 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e.5f7337af-17c9-4162-a8fe-c9569095324e" returned: 0 in 0.332s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-5f7337af-17c9-4162-a8fe-c9569095324e" released by "_delete_snapshot" :: held 1.778s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-6427881c-212c-4c4c-be4a-abfcecc17e9e" released by "delete_snapshot" :: held 1.803s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:35 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Created reservations ['f7f9766f-e816-4600-9ea0-8db535bef427', '41c70f42-3cd0-4624-a1c3-03d4dce68834', '0035a4ce-1e3f-47bf-8296-157a8911e47b', 'ee2f3d79-5bfe-4047-9385-34ac3399d85c'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:35 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Delete snapshot completed successfully. Sep 03 20:20:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2aa5f4a7-6286-4acb-ad75-2251035fcf20 tempest-ProjectMemberTests-371943627 None] Lock "cinder-5f7337af-17c9-4162-a8fe-c9569095324e-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-6427881c-212c-4c4c-be4a-abfcecc17e9e-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Lock "cinder-6427881c-212c-4c4c-be4a-abfcecc17e9e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-6427881c-212c-4c4c-be4a-abfcecc17e9e" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-6427881c-212c-4c4c-be4a-abfcecc17e9e" acquired by "delete_volume" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:35 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9b1729-b568-4bad-8f9f-4f805c4c3d95]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:35 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e Sep 03 20:20:35 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:35 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e" returned: 0 in 0.498s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:36 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e Sep 03 20:20:36 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:36 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6427881c-212c-4c4c-be4a-abfcecc17e9e" returned: 0 in 0.300s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-6427881c-212c-4c4c-be4a-abfcecc17e9e" released by "delete_volume" :: held 0.879s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Created reservations ['468c6d01-b613-462c-846b-3594c1c23e8d', 'bbd93852-23d2-4634-9488-b1e71c831da8', 'b8b5a80b-a9d7-41c9-bd79-e55a4ff93b57', '00c5ba2f-6b39-4938-b4ea-40f7bb55e244'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:36 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:36 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:36 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:36 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:36 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.478s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:36 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:37 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Deleted volume successfully. Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e2658b92-7b9a-4e7f-acd0-90556f547123 tempest-ProjectMemberTests-371943627 None] Lock "cinder-6427881c-212c-4c4c-be4a-abfcecc17e9e-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:37 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.487s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 29 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (759d173d-39fa-41a9-941a-f29ac5ea9b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc7b271-f49a-403e-96fb-72812246f658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc7b271-f49a-403e-96fb-72812246f658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2024160488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad01834-5ba5-4e74-8d68-e402c6797e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:37Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b868ed7-02d5-4fd2-abb9-3a3d78f44c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b868ed7-02d5-4fd2-abb9-3a3d78f44c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b10c3ea-05aa-4397-bc39-c98db155e8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b10c3ea-05aa-4397-bc39-c98db155e8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad01834-5ba5-4e74-8d68-e402c6797e8b', 'volume_name': 'volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e6f4b3-5b67-418c-ba2e-f9cae8a5fc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e6f4b3-5b67-418c-ba2e-f9cae8a5fc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7483e0-268f-4e6c-9529-bb3fdddf7ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:37 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Volume 2ad01834-5ba5-4e74-8d68-e402c6797e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b', 'volume_size': 1} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2024160488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad01834-5ba5-4e74-8d68-e402c6797e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:37Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Creating volume 2ad01834-5ba5-4e74-8d68-e402c6797e8b {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:37 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:37 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b 1073741824 Sep 03 20:20:37 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Flow 'volume_create_manager' (09f4eb59-bf60-43f6-b3e0-8170111d89b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdbedf3-f6fa-4a47-8ba2-e256cae5deda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdbedf3-f6fa-4a47-8ba2-e256cae5deda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062062874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d75fd5-4873-4c4b-b342-fc4fb5b95c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5e33a18c694a1e8db85843d49c270e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:38Z,use_quota=True,user_id='5a8fb2e5ad174ffbb692f154dde53d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a977f95f-99a4-4e81-930f-df316c144505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a977f95f-99a4-4e81-930f-df316c144505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1bcbd7-2fdb-48ee-a548-bcf3df453e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1bcbd7-2fdb-48ee-a548-bcf3df453e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d75fd5-4873-4c4b-b342-fc4fb5b95c32', 'volume_name': 'volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbadf05-f84c-4311-b4a5-4047ea6d7329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbadf05-f84c-4311-b4a5-4047ea6d7329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a1b214-01ae-4acb-b532-f5d0738426fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:38 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:38 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Volume a2d75fd5-4873-4c4b-b342-fc4fb5b95c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32', 'volume_size': 1} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b 1073741824" returned: 0 in 0.663s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:38 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b Sep 03 20:20:38 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:38 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b" returned: 0 in 0.296s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.358s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062062874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d75fd5-4873-4c4b-b342-fc4fb5b95c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5e33a18c694a1e8db85843d49c270e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:38Z,use_quota=True,user_id='5a8fb2e5ad174ffbb692f154dde53d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Creating volume a2d75fd5-4873-4c4b-b342-fc4fb5b95c32 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:38 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7483e0-268f-4e6c-9529-bb3fdddf7ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdd1cc4-7d39-4679-9f91-52f3d5a10462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:38 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32 1073741824 Sep 03 20:20:38 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:38 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Volume volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b (2ad01834-5ba5-4e74-8d68-e402c6797e8b): created successfully Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdd1cc4-7d39-4679-9f91-52f3d5a10462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:38 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (759d173d-39fa-41a9-941a-f29ac5ea9b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:38 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-fa30cfac-cbff-4631-aa6b-613ba2ddf3f1 tempest-ProjectMemberTests-371943627 None] Created volume successfully. Sep 03 20:20:39 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32 1073741824" returned: 0 in 0.528s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:39 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32 Sep 03 20:20:39 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:39 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32" returned: 0 in 0.328s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a1b214-01ae-4acb-b532-f5d0738426fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26768244-f257-49c3-99b9-3fd9873b3617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:39 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Volume volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32 (a2d75fd5-4873-4c4b-b342-fc4fb5b95c32): created successfully Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26768244-f257-49c3-99b9-3fd9873b3617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Flow 'volume_create_manager' (09f4eb59-bf60-43f6-b3e0-8170111d89b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:39 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d8365d2d-936d-4c99-b1ee-01561eb2b6d4 tempest-ProjectReaderTests-260809853 None] Created volume successfully. Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] Creating offline snapshot 499c1aea-4ef2-4eb0-b442-d7e960ae6b3f of volume 2ad01834-5ba5-4e74-8d68-e402c6797e8b {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d388b46e-7901-4573-9073-7c3c3ded796e]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:39 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:39 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b Sep 03 20:20:39 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:40 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b" returned: 0 in 0.427s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:40 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f 1G Sep 03 20:20:40 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Acquiring lock "cinder-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Lock "cinder-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Acquiring lock "cinder-quobyte-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:40 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Lock "cinder-quobyte-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:40 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bf1ce7-518d-4675-a213-a2642ace4ebd]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:40 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f 1G" returned: 0 in 0.593s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:40 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f Sep 03 20:20:40 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:40 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32 Sep 03 20:20:40 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:41 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f" returned: 0 in 0.376s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:41 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f is being set with open permissions: ugo+rw Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:41 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f Sep 03 20:20:41 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:41 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32" returned: 0 in 0.499s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:41 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32 Sep 03 20:20:41 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:41 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32" returned: 0 in 0.349s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:41 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f" returned: 0 in 0.410s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Lock "cinder-quobyte-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32" released by "delete_volume" :: held 0.898s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:41 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.info Sep 03 20:20:41 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Created reservations ['07b5bd07-920d-4d5b-bd01-4137bda1971b', 'c1285fca-e2e4-42a5-9bb2-1a0a9f29e417', 'c99c8247-4d05-4725-8003-63e95f7db650', '96c2debc-9bb8-4000-b1f7-04b2ec78dd6d'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:41 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:41 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:41 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.info" returned: 0 in 0.327s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:41 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.info is being set with open permissions: ugo+rw Sep 03 20:20:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:41 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.info Sep 03 20:20:41 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:42 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.377s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:42 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Deleted volume successfully. Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-c100b8ba-3f3f-48c3-b903-8bf0a9da8477 tempest-ProjectReaderTests-260809853 None] Lock "cinder-a2d75fd5-4873-4c4b-b342-fc4fb5b95c32-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:42 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.info" returned: 0 in 0.406s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.652s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:42 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-be9d6285-e150-4e52-b2ea-21bc32408db0 tempest-ProjectMemberTests-371943627 None] Create snapshot completed successfully Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Flow 'volume_create_manager' (7b2f1d55-bdf8-47b1-a56a-2498c74cbf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b705db1-f784-4603-b91a-94a318ead1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b705db1-f784-4603-b91a-94a318ead1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1359092380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=644ceecb-60c1-4bd4-bf47-342be0bfadf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5e33a18c694a1e8db85843d49c270e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:42Z,use_quota=True,user_id='5a8fb2e5ad174ffbb692f154dde53d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5270b3b-a885-434e-9cc1-8a2d138b9565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5270b3b-a885-434e-9cc1-8a2d138b9565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3798d1-a3a3-4a3d-92f7-19bcebf33d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3798d1-a3a3-4a3d-92f7-19bcebf33d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '644ceecb-60c1-4bd4-bf47-342be0bfadf7', 'volume_name': 'volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e3715f-c621-4da4-933e-97d81544baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e3715f-c621-4da4-933e-97d81544baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f8e2d0-bd70-4cf6-88ca-4833949ebc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:42 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Volume 644ceecb-60c1-4bd4-bf47-342be0bfadf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7', 'volume_size': 1} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1359092380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=644ceecb-60c1-4bd4-bf47-342be0bfadf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5e33a18c694a1e8db85843d49c270e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:42Z,use_quota=True,user_id='5a8fb2e5ad174ffbb692f154dde53d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Creating volume 644ceecb-60c1-4bd4-bf47-342be0bfadf7 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:42 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:42 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7 1073741824 Sep 03 20:20:42 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:42 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-499c1aea-4ef2-4eb0-b442-d7e960ae6b3f-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Lock "cinder-499c1aea-4ef2-4eb0-b442-d7e960ae6b3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-2ad01834-5ba5-4e74-8d68-e402c6797e8b" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-2ad01834-5ba5-4e74-8d68-e402c6797e8b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-499c1aea-4ef2-4eb0-b442-d7e960ae6b3f" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-499c1aea-4ef2-4eb0-b442-d7e960ae6b3f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Deleting offline snapshot 499c1aea-4ef2-4eb0-b442-d7e960ae6b3f of volume 2ad01834-5ba5-4e74-8d68-e402c6797e8b {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] snapshot_file for this snap is: volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d898290-1662-42d9-bd69-7864571ab3cb]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:43 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7 1073741824" returned: 0 in 0.587s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:43 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7 Sep 03 20:20:43 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:43 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f Sep 03 20:20:43 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:43 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7" returned: 0 in 0.288s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f8e2d0-bd70-4cf6-88ca-4833949ebc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebdc5f51-0c54-47e3-bc88-4dd8cae9c450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:43 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Volume volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7 (644ceecb-60c1-4bd4-bf47-342be0bfadf7): created successfully Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebdc5f51-0c54-47e3-bc88-4dd8cae9c450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Flow 'volume_create_manager' (7b2f1d55-bdf8-47b1-a56a-2498c74cbf28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:43 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-cfb3f15b-ed95-4b69-9b68-c9e9d2d7807a tempest-ProjectReaderTests-260809853 None] Created volume successfully. Sep 03 20:20:43 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f" returned: 0 in 0.455s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[467622fe-6f81-4fb2-9103-051188a89b05]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:43 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b Sep 03 20:20:43 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:44 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b" returned: 0 in 0.417s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:44 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f Sep 03 20:20:44 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:44 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f" returned: 0 in 0.434s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:44 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f Sep 03 20:20:44 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Acquiring lock "cinder-644ceecb-60c1-4bd4-bf47-342be0bfadf7-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Lock "cinder-644ceecb-60c1-4bd4-bf47-342be0bfadf7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Acquiring lock "cinder-quobyte-644ceecb-60c1-4bd4-bf47-342be0bfadf7" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:44 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Lock "cinder-quobyte-644ceecb-60c1-4bd4-bf47-342be0bfadf7" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:44 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[386af04d-0f8e-4977-be64-b06933fa436d]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:44 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7 Sep 03 20:20:44 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:44 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b.499c1aea-4ef2-4eb0-b442-d7e960ae6b3f" returned: 0 in 0.514s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-499c1aea-4ef2-4eb0-b442-d7e960ae6b3f" released by "_delete_snapshot" :: held 1.979s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-2ad01834-5ba5-4e74-8d68-e402c6797e8b" released by "delete_snapshot" :: held 2.040s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Created reservations ['6e57e562-24ae-4f77-8f9a-b9069a11865a', '82d61fa6-bf9c-47e6-bb2e-7132728a3063', '786a2d02-fa52-4689-82dc-0b5783cbb7f1', 'c92caec4-d609-4a51-ba20-1a0d6491483e'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:45 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Delete snapshot completed successfully. Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-963aa0f3-91f8-4f70-8380-862a22ba178c tempest-ProjectMemberTests-371943627 None] Lock "cinder-499c1aea-4ef2-4eb0-b442-d7e960ae6b3f-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:45 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7" returned: 0 in 0.613s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:45 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7 Sep 03 20:20:45 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:45 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-644ceecb-60c1-4bd4-bf47-342be0bfadf7" returned: 0 in 0.345s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Lock "cinder-quobyte-644ceecb-60c1-4bd4-bf47-342be0bfadf7" released by "delete_volume" :: held 1.010s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Created reservations ['7ee9b7f5-7a42-44fb-8ca2-9ec240e47527', '53eb0ecd-07e5-4d2d-857d-5f2d224c1d99', 'c887780d-0f3b-44e8-bffa-e5f91cb8f70f', '35ba66a2-4622-4961-85e8-3db3aae45ed5'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:45 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:45 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:46 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.269s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:46 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:46 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Deleted volume successfully. Sep 03 20:20:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-af54acec-d5d1-4c78-879c-8d0b0f2aed65 tempest-ProjectReaderTests-260809853 None] Lock "cinder-644ceecb-60c1-4bd4-bf47-342be0bfadf7-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-2ad01834-5ba5-4e74-8d68-e402c6797e8b-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Lock "cinder-2ad01834-5ba5-4e74-8d68-e402c6797e8b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-2ad01834-5ba5-4e74-8d68-e402c6797e8b" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-2ad01834-5ba5-4e74-8d68-e402c6797e8b" acquired by "delete_volume" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:46 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af563cc-cd8a-41cd-ac6e-cdae771384e1]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:46 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b Sep 03 20:20:46 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:46 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b" returned: 0 in 0.501s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:46 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b Sep 03 20:20:46 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:47 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-2ad01834-5ba5-4e74-8d68-e402c6797e8b" returned: 0 in 0.489s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-2ad01834-5ba5-4e74-8d68-e402c6797e8b" released by "delete_volume" :: held 1.072s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:47 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Created reservations ['e171f034-b64c-4498-b880-4e1765b3a65e', 'dd2c7d8e-2da8-4a33-ad5b-854749f3b9ec', '5d6c404b-7b79-4fdb-a140-e293ceb51742', '815bb65c-c08e-4f1a-a3e7-81bb01765c95'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:47 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:47 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:47 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.311s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:47 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Deleted volume successfully. Sep 03 20:20:48 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-55287fcc-da32-403d-85b1-eceee8dafe00 tempest-ProjectMemberTests-371943627 None] Lock "cinder-2ad01834-5ba5-4e74-8d68-e402c6797e8b-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (84bd6ba0-1be7-4b5f-b3f6-bb72d6e1c5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42a796e-486d-4500-b2c9-8e59dfec1b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42a796e-486d-4500-b2c9-8e59dfec1b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793367055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a13513-19af-454c-9a5e-8a0ebf2838f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:49Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db027bb7-d963-46ed-9093-9c21e63e18ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db027bb7-d963-46ed-9093-9c21e63e18ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729dc3c0-c991-4151-ad57-ba48292b3105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729dc3c0-c991-4151-ad57-ba48292b3105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a13513-19af-454c-9a5e-8a0ebf2838f2', 'volume_name': 'volume-84a13513-19af-454c-9a5e-8a0ebf2838f2', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cb51d5-550a-4d91-91ce-d6059e0d7fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cb51d5-550a-4d91-91ce-d6059e0d7fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f686a9b-47c6-4313-873f-79c5d14c38dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:49 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Volume 84a13513-19af-454c-9a5e-8a0ebf2838f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a13513-19af-454c-9a5e-8a0ebf2838f2', 'volume_size': 1} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793367055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a13513-19af-454c-9a5e-8a0ebf2838f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:20:49Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Creating volume 84a13513-19af-454c-9a5e-8a0ebf2838f2 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:49 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:49 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 1073741824 Sep 03 20:20:49 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:49 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 1073741824" returned: 0 in 0.640s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:49 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 Sep 03 20:20:49 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:50 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2" returned: 0 in 0.413s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:50 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:20:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f686a9b-47c6-4313-873f-79c5d14c38dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a13513-19af-454c-9a5e-8a0ebf2838f2', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca12cf3e-0aba-4296-8b23-ab9bb667752d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:50 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Volume volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 (84a13513-19af-454c-9a5e-8a0ebf2838f2): created successfully Sep 03 20:20:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca12cf3e-0aba-4296-8b23-ab9bb667752d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:50 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (84bd6ba0-1be7-4b5f-b3f6-bb72d6e1c5b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-174784e2-b0fb-457f-b71c-5f237a92835a tempest-ProjectMemberTests-371943627 None] Created volume successfully. Sep 03 20:20:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] Creating offline snapshot 58788cfe-e188-4dd8-8304-d2f323f35af9 of volume 84a13513-19af-454c-9a5e-8a0ebf2838f2 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:20:51 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8567119-f2ef-4995-a48e-247b17c7ae7b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:51 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 Sep 03 20:20:51 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:51 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2" returned: 0 in 0.430s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:52 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 1G Sep 03 20:20:52 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:52 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 1G" returned: 0 in 0.467s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:52 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 Sep 03 20:20:52 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:52 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9" returned: 0 in 0.331s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:52 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 is being set with open permissions: ugo+rw Sep 03 20:20:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:52 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 Sep 03 20:20:52 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:53 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9" returned: 0 in 0.276s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:53 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.info Sep 03 20:20:53 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:53 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.info" returned: 0 in 0.289s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:53 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.info is being set with open permissions: ugo+rw Sep 03 20:20:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:53 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.info Sep 03 20:20:53 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:53 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.info" returned: 0 in 0.309s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:53 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ae1e8e7f-4d23-4374-8a78-d1bdb938b0ac tempest-ProjectMemberTests-371943627 None] Create snapshot completed successfully Sep 03 20:20:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-58788cfe-e188-4dd8-8304-d2f323f35af9-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Lock "cinder-58788cfe-e188-4dd8-8304-d2f323f35af9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-84a13513-19af-454c-9a5e-8a0ebf2838f2" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-84a13513-19af-454c-9a5e-8a0ebf2838f2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-58788cfe-e188-4dd8-8304-d2f323f35af9" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-58788cfe-e188-4dd8-8304-d2f323f35af9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Deleting offline snapshot 58788cfe-e188-4dd8-8304-d2f323f35af9 of volume 84a13513-19af-454c-9a5e-8a0ebf2838f2 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:20:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] snapshot_file for this snap is: volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:20:54 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd91ff3-d841-4825-a84c-b8b54fafa4ab]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:55 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 Sep 03 20:20:55 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:55 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9" returned: 0 in 0.401s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84a13513-19af-454c-9a5e-8a0ebf2838f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:20:55 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[65241a4f-cc68-437d-b473-2dc3ddbb5e48]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:55 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 Sep 03 20:20:55 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:55 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2" returned: 0 in 0.410s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:55 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 Sep 03 20:20:55 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:56 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9" returned: 0 in 0.511s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:56 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9 Sep 03 20:20:56 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:56 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2.58788cfe-e188-4dd8-8304-d2f323f35af9" returned: 0 in 0.275s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-58788cfe-e188-4dd8-8304-d2f323f35af9" released by "_delete_snapshot" :: held 1.715s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-84a13513-19af-454c-9a5e-8a0ebf2838f2" released by "delete_snapshot" :: held 1.744s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:56 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Created reservations ['f527a808-b8b8-4421-bd45-a12fcee72f3f', 'cb792041-e54e-4839-879c-ea7697534fed', 'cecb474b-a1b2-48a2-915e-902d915179bc', 'd3e4505b-89f3-4638-895f-30b0c718c8f5'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:56 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Delete snapshot completed successfully. Sep 03 20:20:56 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fb74be3d-9cf5-40b5-9947-bb2f8392b9b0 tempest-ProjectMemberTests-371943627 None] Lock "cinder-58788cfe-e188-4dd8-8304-d2f323f35af9-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-84a13513-19af-454c-9a5e-8a0ebf2838f2-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Lock "cinder-84a13513-19af-454c-9a5e-8a0ebf2838f2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-84a13513-19af-454c-9a5e-8a0ebf2838f2" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:20:57 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-84a13513-19af-454c-9a5e-8a0ebf2838f2" acquired by "delete_volume" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:20:57 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff938d9-2cc1-45f0-8ca7-1110f6f67781]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:20:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:57 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 Sep 03 20:20:57 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:57 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2" returned: 0 in 0.466s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:57 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2 Sep 03 20:20:57 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:58 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-84a13513-19af-454c-9a5e-8a0ebf2838f2" returned: 0 in 0.348s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-84a13513-19af-454c-9a5e-8a0ebf2838f2" released by "delete_volume" :: held 0.901s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:58 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Created reservations ['9f4dbed3-f7ba-4a27-a4a9-48c00ebc1102', 'e32bcd0b-c62d-4ab6-9cad-e092a24bf271', '76113b7c-fe16-42c4-a6d6-1e13ba2fd292', 'b37d6dc1-2ad4-4c4b-b97e-03e4d7755a4d'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:20:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:20:58 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:20:58 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:20:58 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 03 20:20:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.329s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:20:58 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:20:58 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Deleted volume successfully. Sep 03 20:20:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1cbac3f4-ee2c-4f58-bef4-f85b6320fa29 tempest-ProjectMemberTests-371943627 None] Lock "cinder-84a13513-19af-454c-9a5e-8a0ebf2838f2-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (50c39965-0876-4bd1-a9b7-7bca21ad236b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0ac35a-e771-4b53-a220-20253ecaf050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0ac35a-e771-4b53-a220-20253ecaf050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2093481879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d4a69e-6c3c-46b8-8618-41adf2383e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:00Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4115d2f7-2557-4a27-96fc-a2ae1a0aae12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4115d2f7-2557-4a27-96fc-a2ae1a0aae12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260a1dbc-8152-410b-af1e-3c889131850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260a1dbc-8152-410b-af1e-3c889131850f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07d4a69e-6c3c-46b8-8618-41adf2383e27', 'volume_name': 'volume-07d4a69e-6c3c-46b8-8618-41adf2383e27', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90cb44c8-1fce-4750-9f27-167ee785f438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90cb44c8-1fce-4750-9f27-167ee785f438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0e7a8b-5701-4350-ac34-f03f24af0338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:20:59 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Volume 07d4a69e-6c3c-46b8-8618-41adf2383e27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07d4a69e-6c3c-46b8-8618-41adf2383e27', 'volume_size': 1} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2093481879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d4a69e-6c3c-46b8-8618-41adf2383e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:00Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Creating volume 07d4a69e-6c3c-46b8-8618-41adf2383e27 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:20:59 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:20:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:00 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 1073741824 Sep 03 20:21:00 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:00 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 1073741824" returned: 0 in 0.489s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:00 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 Sep 03 20:21:00 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:00 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27" returned: 0 in 0.272s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:00 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:21:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:00 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0e7a8b-5701-4350-ac34-f03f24af0338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d4a69e-6c3c-46b8-8618-41adf2383e27', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:00 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d622de2b-fe03-43b7-8346-1854ad9ba9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:00 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Volume volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 (07d4a69e-6c3c-46b8-8618-41adf2383e27): created successfully Sep 03 20:21:00 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d622de2b-fe03-43b7-8346-1854ad9ba9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:00 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (50c39965-0876-4bd1-a9b7-7bca21ad236b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:00 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-cea1acce-d6ca-4b47-a36e-34712eefc12d tempest-ProjectMemberTests-371943627 None] Created volume successfully. Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Flow 'volume_create_manager' (8fe9fc3a-1ae9-4b00-956b-c9c6c5372010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38452f48-6719-40cb-8f59-37ea49f92339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38452f48-6719-40cb-8f59-37ea49f92339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1819197390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d3986f-1d77-487a-a59a-eda05ecee157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a387c48201fe48bea3498e61544b804b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:02Z,use_quota=True,user_id='503c6c003ea44582afd2172f9ecec069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47c3ed6-1dee-407d-ae6e-e8be547fae4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47c3ed6-1dee-407d-ae6e-e8be547fae4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37dfc41-13f1-421d-8138-1654164538bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37dfc41-13f1-421d-8138-1654164538bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d3986f-1d77-487a-a59a-eda05ecee157', 'volume_name': 'volume-04d3986f-1d77-487a-a59a-eda05ecee157', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b356019e-a057-4809-931f-aedad68a7dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b356019e-a057-4809-931f-aedad68a7dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a83f59-247e-4a32-ae5d-e1435d8bc77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:02 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Volume 04d3986f-1d77-487a-a59a-eda05ecee157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d3986f-1d77-487a-a59a-eda05ecee157', 'volume_size': 1} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1819197390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d3986f-1d77-487a-a59a-eda05ecee157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a387c48201fe48bea3498e61544b804b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:02Z,use_quota=True,user_id='503c6c003ea44582afd2172f9ecec069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Creating volume 04d3986f-1d77-487a-a59a-eda05ecee157 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:21:02 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:02 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 1073741824 Sep 03 20:21:02 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:02 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 1073741824" returned: 0 in 0.391s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:02 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 Sep 03 20:21:02 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:02 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157" returned: 0 in 0.246s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.645s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] Creating offline snapshot 6ce89de4-c524-4f98-95b4-9b3e06f4ad2c of volume 07d4a69e-6c3c-46b8-8618-41adf2383e27 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a83f59-247e-4a32-ae5d-e1435d8bc77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d3986f-1d77-487a-a59a-eda05ecee157', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b40e74-6233-42b1-8423-804eec459248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8adc61-e8ff-4266-b620-798f1297293f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:03 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Volume volume-04d3986f-1d77-487a-a59a-eda05ecee157 (04d3986f-1d77-487a-a59a-eda05ecee157): created successfully Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b40e74-6233-42b1-8423-804eec459248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Flow 'volume_create_manager' (8fe9fc3a-1ae9-4b00-956b-c9c6c5372010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:03 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ba2a0792-2efa-4673-9e1b-42fac6cf1b54 tempest-SnapshotDependencyTests-1098872582 None] Created volume successfully. Sep 03 20:21:03 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 Sep 03 20:21:03 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:03 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27" returned: 0 in 0.352s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:03 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c 1G Sep 03 20:21:03 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:03 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c 1G" returned: 0 in 0.366s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:03 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c Sep 03 20:21:03 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:04 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c" returned: 0 in 0.281s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:04 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c is being set with open permissions: ugo+rw Sep 03 20:21:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:04 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c Sep 03 20:21:04 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:04 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c" returned: 0 in 0.247s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:04 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.info Sep 03 20:21:04 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:04 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.info" returned: 0 in 0.265s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:04 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.info is being set with open permissions: ugo+rw Sep 03 20:21:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:04 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.info Sep 03 20:21:04 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:04 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.info" returned: 0 in 0.231s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.368s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:04 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] Creating offline snapshot a1184dcd-44c6-40f1-95a4-000b96557372 of volume 04d3986f-1d77-487a-a59a-eda05ecee157 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:21:04 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4a552c-578a-4a94-ac65-ad88dec1cf2a]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:04 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f4fb2cff-ca6f-4538-9531-b729ae5c9b45 tempest-ProjectMemberTests-371943627 None] Create snapshot completed successfully Sep 03 20:21:04 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 Sep 03 20:21:04 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:05 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157" returned: 0 in 0.344s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:05 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 1G Sep 03 20:21:05 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-6ce89de4-c524-4f98-95b4-9b3e06f4ad2c-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Lock "cinder-6ce89de4-c524-4f98-95b4-9b3e06f4ad2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-07d4a69e-6c3c-46b8-8618-41adf2383e27" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-07d4a69e-6c3c-46b8-8618-41adf2383e27" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-6ce89de4-c524-4f98-95b4-9b3e06f4ad2c" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-6ce89de4-c524-4f98-95b4-9b3e06f4ad2c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Deleting offline snapshot 6ce89de4-c524-4f98-95b4-9b3e06f4ad2c of volume 07d4a69e-6c3c-46b8-8618-41adf2383e27 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] snapshot_file for this snap is: volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a8de49-b961-450d-9fab-a0223d97fe7f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:05 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c Sep 03 20:21:05 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:05 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 1G" returned: 0 in 0.380s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04d3986f-1d77-487a-a59a-eda05ecee157 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:05 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04d3986f-1d77-487a-a59a-eda05ecee157 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 Sep 03 20:21:05 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:05 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c" returned: 0 in 0.361s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07d4a69e-6c3c-46b8-8618-41adf2383e27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df126f4-6af2-4db5-82a4-fbaee243d5ea]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:05 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 Sep 03 20:21:05 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:05 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04d3986f-1d77-487a-a59a-eda05ecee157 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372" returned: 0 in 0.287s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:05 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 is being set with open permissions: ugo+rw Sep 03 20:21:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:05 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 Sep 03 20:21:05 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:06 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372" returned: 0 in 0.241s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:06 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27" returned: 0 in 0.361s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:06 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c Sep 03 20:21:06 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:06 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.info Sep 03 20:21:06 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:06 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.info" returned: 0 in 0.254s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:06 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.info is being set with open permissions: ugo+rw Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:06 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.info Sep 03 20:21:06 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:06 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c" returned: 0 in 0.376s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:06 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c Sep 03 20:21:06 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:06 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.info" returned: 0 in 0.259s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:06 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7cbd529c-dabc-4c2b-89ee-30ad2d130294 tempest-SnapshotDependencyTests-1098872582 None] Create snapshot completed successfully Sep 03 20:21:06 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27.6ce89de4-c524-4f98-95b4-9b3e06f4ad2c" returned: 0 in 0.245s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-6ce89de4-c524-4f98-95b4-9b3e06f4ad2c" released by "_delete_snapshot" :: held 1.430s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-07d4a69e-6c3c-46b8-8618-41adf2383e27" released by "delete_snapshot" :: held 1.453s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Created reservations ['287ad6eb-b3ca-4f3d-af5e-7f139bff80a5', '449affda-041e-4551-ac5c-7b305607fe4e', 'be63c2bd-d2e0-46a9-b00e-f5ad88d7d1a7', 'ebe4c1b8-b7b7-4caf-a33d-4069fc338bd7'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:06 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Delete snapshot completed successfully. Sep 03 20:21:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-fa1046ce-a214-4674-9d52-77745648dc3d tempest-ProjectMemberTests-371943627 None] Lock "cinder-6ce89de4-c524-4f98-95b4-9b3e06f4ad2c-delete_snapshot" released by "delete_snapshot" :: held 1.578s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-07d4a69e-6c3c-46b8-8618-41adf2383e27-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Lock "cinder-07d4a69e-6c3c-46b8-8618-41adf2383e27-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-07d4a69e-6c3c-46b8-8618-41adf2383e27" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-07d4a69e-6c3c-46b8-8618-41adf2383e27" acquired by "delete_volume" :: waited 0.023s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:07 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ea088f-a623-4e01-9ba1-7b9482759a59]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:07 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 Sep 03 20:21:07 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:07 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27" returned: 0 in 0.364s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:07 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27 Sep 03 20:21:07 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:21:08 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-07d4a69e-6c3c-46b8-8618-41adf2383e27" returned: 0 in 0.253s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-07d4a69e-6c3c-46b8-8618-41adf2383e27" released by "delete_volume" :: held 0.678s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Flow 'volume_create_manager' (ab135afd-a088-4781-93ac-047dff419577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44499fa4-509a-46bf-9bac-aacae423ad33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44499fa4-509a-46bf-9bac-aacae423ad33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a06fe11-d77f-44f1-a5a1-72d9077c69b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a387c48201fe48bea3498e61544b804b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1184dcd-44c6-40f1-95a4-000b96557372,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:08Z,use_quota=True,user_id='503c6c003ea44582afd2172f9ecec069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47575212-b1b4-48ae-865f-7562f867e272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47575212-b1b4-48ae-865f-7562f867e272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96792f2-7baf-42a4-b573-867940de63fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96792f2-7baf-42a4-b573-867940de63fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1a06fe11-d77f-44f1-a5a1-72d9077c69b9', 'volume_name': 'volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9', 'volume_size': 1, 'snapshot_id': 'a1184dcd-44c6-40f1-95a4-000b96557372'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a143cfe2-f151-44b2-9f17-c8fb102c7b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a143cfe2-f151-44b2-9f17-c8fb102c7b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1007af8-0598-4e20-a317-68ed9e23f6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:08 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Volume 1a06fe11-d77f-44f1-a5a1-72d9077c69b9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9', 'volume_size': 1, 'snapshot_id': 'a1184dcd-44c6-40f1-95a4-000b96557372'} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "cinder-quobyte-a1184dcd-44c6-40f1-95a4-000b96557372-1a06fe11-d77f-44f1-a5a1-72d9077c69b9" by "_create_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-quobyte-a1184dcd-44c6-40f1-95a4-000b96557372-1a06fe11-d77f-44f1-a5a1-72d9077c69b9" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Creating volume 1a06fe11-d77f-44f1-a5a1-72d9077c69b9 from snapshot a1184dcd-44c6-40f1-95a4-000b96557372 {{(pid=87582) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "cinder-quobyte-1a06fe11-d77f-44f1-a5a1-72d9077c69b9" by "_copy_volume_from_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-quobyte-1a06fe11-d77f-44f1-a5a1-72d9077c69b9" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] snapshot: a1184dcd-44c6-40f1-95a4-000b96557372, volume: 1a06fe11-d77f-44f1-a5a1-72d9077c69b9, {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Created reservations ['ff46334f-f64a-4d29-8c68-2aab20934ce6', '880c4261-dee0-4953-9703-a77a16e1afb1', '051e0cc6-be0c-4985-970e-f50b97cd2df0', '0958463d-97fa-4d41-8fff-b1ef7d6c6615'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a45e682-991e-4e5f-9ec4-b2bc10859f77]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:08 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:21:08 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:08 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 Sep 03 20:21:08 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:08 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.260s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:21:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Deleted volume successfully. Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a2655d93-bfe9-4ea6-9e2e-eafe3360a786 tempest-ProjectMemberTests-371943627 None] Lock "cinder-07d4a69e-6c3c-46b8-8618-41adf2383e27-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:08 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372" returned: 0 in 0.386s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04d3986f-1d77-487a-a59a-eda05ecee157(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5914389-9c00-4579-a3c1-d0ce4c741eda]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:08 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 Sep 03 20:21:08 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (67b4318f-a844-411b-afcb-3fc6615d9127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4785134-d08e-4782-bd6f-60009397bc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4785134-d08e-4782-bd6f-60009397bc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213941051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b22d51-1030-437b-9c53-fd192d4e0d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:09Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72129b5-daf3-4a93-b681-35f49a5f9fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72129b5-daf3-4a93-b681-35f49a5f9fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57c00c4-e9c4-49f4-8c75-75abd5e04f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57c00c4-e9c4-49f4-8c75-75abd5e04f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b22d51-1030-437b-9c53-fd192d4e0d2f', 'volume_name': 'volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b34180-c48f-4a19-9aa7-baec7c10e1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b34180-c48f-4a19-9aa7-baec7c10e1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6d9278-bb15-4f68-b0c7-cc1bf20c3fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:09 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Volume a5b22d51-1030-437b-9c53-fd192d4e0d2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f', 'volume_size': 1} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:09 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157" returned: 0 in 0.437s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Creating direct copy from snapshot {{(pid=87582) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG cinder.utils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Path /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9 not found in is_blk_device check {{(pid=87582) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 20:21:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:09 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9 Sep 03 20:21:09 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:13 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9" returned: 0 in 3.905s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.image.image_utils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Image conversion details: src /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157, size 1024.00 MB, duration 3.91 sec, destination /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9 {{(pid=87582) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 20:21:13 devstack cinder-volume[87582]: INFO cinder.image.image_utils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Converted 1024.00 MB image at 262.12 MB/s Sep 03 20:21:13 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9 is being set with open permissions: ugo+rw Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:13 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9 Sep 03 20:21:13 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:13 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9" returned: 0 in 0.234s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-quobyte-1a06fe11-d77f-44f1-a5a1-72d9077c69b9" released by "_copy_volume_from_snapshot" :: held 5.049s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-quobyte-a1184dcd-44c6-40f1-95a4-000b96557372-1a06fe11-d77f-44f1-a5a1-72d9077c69b9" released by "_create_volume_from_snapshot" :: held 5.111s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.129s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.253s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213941051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b22d51-1030-437b-9c53-fd192d4e0d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:09Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Creating volume a5b22d51-1030-437b-9c53-fd192d4e0d2f {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:21:13 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:13 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f 1073741824 Sep 03 20:21:13 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1007af8-0598-4e20-a317-68ed9e23f6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9', 'volume_size': 1, 'snapshot_id': 'a1184dcd-44c6-40f1-95a4-000b96557372'}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0795fa-95ac-4d65-bb8a-cd5ae01ee24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:13 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Volume volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9 (1a06fe11-d77f-44f1-a5a1-72d9077c69b9): created successfully Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0795fa-95ac-4d65-bb8a-cd5ae01ee24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Flow 'volume_create_manager' (ab135afd-a088-4781-93ac-047dff419577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:13 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-226df964-b0ce-4cf7-a98d-163d4d8e8438 tempest-SnapshotDependencyTests-1098872582 None] Created volume successfully. Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "cinder-a1184dcd-44c6-40f1-95a4-000b96557372-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-a1184dcd-44c6-40f1-95a4-000b96557372-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "cinder-quobyte-04d3986f-1d77-487a-a59a-eda05ecee157" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-quobyte-04d3986f-1d77-487a-a59a-eda05ecee157" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "cinder-quobyte-a1184dcd-44c6-40f1-95a4-000b96557372" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-quobyte-a1184dcd-44c6-40f1-95a4-000b96557372" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Deleting offline snapshot a1184dcd-44c6-40f1-95a4-000b96557372 of volume 04d3986f-1d77-487a-a59a-eda05ecee157 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] snapshot_file for this snap is: volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ec7c66-9173-4566-b6e8-8ec5e998af0f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:13 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f 1073741824" returned: 0 in 0.446s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:13 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 Sep 03 20:21:13 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:13 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f Sep 03 20:21:13 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:14 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372" returned: 0 in 0.352s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04d3986f-1d77-487a-a59a-eda05ecee157(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:21:14 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f" returned: 0 in 0.240s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaafcbf-7057-40d1-a2a9-6048597a87dd]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6d9278-bb15-4f68-b0c7-cc1bf20c3fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3dc5c60-a809-412f-92a6-cc66eca113fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:14 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Volume volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f (a5b22d51-1030-437b-9c53-fd192d4e0d2f): created successfully Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3dc5c60-a809-412f-92a6-cc66eca113fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (67b4318f-a844-411b-afcb-3fc6615d9127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:14 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7f1a6540-92f7-4ac2-aa33-ee775e059c88 tempest-ProjectMemberTests-371943627 None] Created volume successfully. Sep 03 20:21:14 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 Sep 03 20:21:14 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:14 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157" returned: 0 in 0.508s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:14 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 Sep 03 20:21:14 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] Creating offline snapshot b6ae3789-cdda-469d-b689-bc9f57b6820a of volume a5b22d51-1030-437b-9c53-fd192d4e0d2f {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf0393b-bf84-4bd7-a2a6-b56592a50a28]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:15 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372" returned: 0 in 0.350s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:15 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f Sep 03 20:21:15 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:15 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372 Sep 03 20:21:15 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:15 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157.a1184dcd-44c6-40f1-95a4-000b96557372" returned: 0 in 0.240s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:15 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f" returned: 0 in 0.387s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-quobyte-a1184dcd-44c6-40f1-95a4-000b96557372" released by "_delete_snapshot" :: held 1.568s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-quobyte-04d3986f-1d77-487a-a59a-eda05ecee157" released by "delete_snapshot" :: held 1.595s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:15 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a 1G Sep 03 20:21:15 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Created reservations ['592b8932-aee6-4c28-b679-dbf0035253a8', '0f14568b-97a3-46c7-a9a7-5a0624a22287', '8fdac93a-75a8-48c4-b172-782d52573b08', 'ffcd15c9-b52f-441d-b7d7-52418b50c7ef'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:15 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Delete snapshot completed successfully. Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-16fe392d-3f2a-468c-a307-c5d63a5c2ca2 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-a1184dcd-44c6-40f1-95a4-000b96557372-delete_snapshot" released by "delete_snapshot" :: held 1.775s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:15 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a 1G" returned: 0 in 0.409s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:15 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a Sep 03 20:21:15 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "cinder-04d3986f-1d77-487a-a59a-eda05ecee157-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-04d3986f-1d77-487a-a59a-eda05ecee157-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "cinder-quobyte-04d3986f-1d77-487a-a59a-eda05ecee157" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-quobyte-04d3986f-1d77-487a-a59a-eda05ecee157" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4b3a33-eee8-4697-894a-fb6ae550ee60]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:16 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a" returned: 0 in 0.318s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:16 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a is being set with open permissions: ugo+rw Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:16 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a Sep 03 20:21:16 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:16 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 Sep 03 20:21:16 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:16 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a" returned: 0 in 0.282s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:16 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157" returned: 0 in 0.352s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:16 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.info Sep 03 20:21:16 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:16 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157 Sep 03 20:21:16 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:16 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.info" returned: 0 in 0.247s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:16 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.info is being set with open permissions: ugo+rw Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:16 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.info Sep 03 20:21:16 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:16 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-04d3986f-1d77-487a-a59a-eda05ecee157" returned: 0 in 0.282s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-quobyte-04d3986f-1d77-487a-a59a-eda05ecee157" released by "delete_volume" :: held 0.695s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Created reservations ['6c1bd57d-bbea-4cb1-9ea7-c8e98860f772', '4342291c-e11e-4ae9-90b7-7099bf7905ef', 'ba905037-0ba3-4661-9322-6709dae9b438', '07229997-681e-477a-bd7f-536393f5304e'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:16 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:21:16 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:16 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.info" returned: 0 in 0.249s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:16 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.997s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:16 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-30cd0f4b-3647-434b-b2d1-aff60950982c tempest-ProjectMemberTests-371943627 None] Create snapshot completed successfully Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "cinder-1a06fe11-d77f-44f1-a5a1-72d9077c69b9-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-1a06fe11-d77f-44f1-a5a1-72d9077c69b9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:17 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.299s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "cinder-quobyte-1a06fe11-d77f-44f1-a5a1-72d9077c69b9" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:17 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Deleted volume successfully. Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-quobyte-1a06fe11-d77f-44f1-a5a1-72d9077c69b9" acquired by "delete_volume" :: waited 0.025s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-83660396-ba87-4057-b40b-218b379d0598 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-04d3986f-1d77-487a-a59a-eda05ecee157-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc60844a-0f72-483c-85a1-2eed6f63248e]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:17 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9 Sep 03 20:21:17 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:17 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9" returned: 0 in 0.352s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:17 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9 Sep 03 20:21:17 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:17 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-1a06fe11-d77f-44f1-a5a1-72d9077c69b9" returned: 0 in 0.247s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-quobyte-1a06fe11-d77f-44f1-a5a1-72d9077c69b9" released by "delete_volume" :: held 0.645s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Created reservations ['7c38219e-098f-43af-9493-f5ee27abaf94', '3a64fd14-4e60-4c5c-9407-32d04226ea53', '80ba5f22-4644-43f9-958e-6b4f24449c2f', '12b77939-661b-43c0-98aa-bf82a72909b0'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:17 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:17 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:21:17 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-b6ae3789-cdda-469d-b689-bc9f57b6820a-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Lock "cinder-b6ae3789-cdda-469d-b689-bc9f57b6820a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-a5b22d51-1030-437b-9c53-fd192d4e0d2f" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-a5b22d51-1030-437b-9c53-fd192d4e0d2f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-b6ae3789-cdda-469d-b689-bc9f57b6820a" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-b6ae3789-cdda-469d-b689-bc9f57b6820a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Deleting offline snapshot b6ae3789-cdda-469d-b689-bc9f57b6820a of volume a5b22d51-1030-437b-9c53-fd192d4e0d2f {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] snapshot_file for this snap is: volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faff0b8-9772-4a9a-beac-2ad625e75c46]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:18 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.254s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:21:18 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Deleted volume successfully. Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-5f724e35-4c1d-4140-9e1d-85f7d462f339 tempest-SnapshotDependencyTests-1098872582 None] Lock "cinder-1a06fe11-d77f-44f1-a5a1-72d9077c69b9-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:18 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a Sep 03 20:21:18 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:18 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a" returned: 0 in 0.373s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[489c33b3-7bb1-446c-9a5d-bfa2b486d5ef]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:18 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f Sep 03 20:21:18 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:18 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f" returned: 0 in 0.360s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:18 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:18 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a Sep 03 20:21:18 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:19 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a" returned: 0 in 0.400s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:19 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a Sep 03 20:21:19 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:19 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:19 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f.b6ae3789-cdda-469d-b689-bc9f57b6820a" returned: 0 in 0.256s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-b6ae3789-cdda-469d-b689-bc9f57b6820a" released by "_delete_snapshot" :: held 1.484s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-a5b22d51-1030-437b-9c53-fd192d4e0d2f" released by "delete_snapshot" :: held 1.511s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:19 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Created reservations ['dae7ce3d-c1ad-49cf-ba65-d948bb2ffba0', 'cd37d06e-18c4-4231-b0ce-d1dc40608052', 'f54c219c-50bb-44f9-a4ce-6198feef0a6c', '246359de-0505-4ab6-935c-847d9cd67fd8'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:19 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Delete snapshot completed successfully. Sep 03 20:21:19 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-b468e270-605b-4e47-b69e-6566de273bb1 tempest-ProjectMemberTests-371943627 None] Lock "cinder-b6ae3789-cdda-469d-b689-bc9f57b6820a-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-a5b22d51-1030-437b-9c53-fd192d4e0d2f-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Lock "cinder-a5b22d51-1030-437b-9c53-fd192d4e0d2f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-a5b22d51-1030-437b-9c53-fd192d4e0d2f" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-a5b22d51-1030-437b-9c53-fd192d4e0d2f" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:20 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[beefde4c-628c-4232-9098-e8021ef0e52c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:20 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f Sep 03 20:21:20 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:20 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f" returned: 0 in 0.377s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:20 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f Sep 03 20:21:20 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:20 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:20 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-a5b22d51-1030-437b-9c53-fd192d4e0d2f" returned: 0 in 0.256s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:20 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-a5b22d51-1030-437b-9c53-fd192d4e0d2f" released by "delete_volume" :: held 0.706s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Created reservations ['0fd0a773-003a-45fa-b79b-b3acc1d55bdd', '07dd807f-b32a-438a-999a-6d7a45e57c7e', '8f3127ac-2c05-448e-bb67-e5cdca763004', '43112360-32c6-46f9-8113-d012623aa6af'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:21 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:21:21 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:21 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.243s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:21:21 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Deleted volume successfully. Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-cda81000-158b-4c0e-8d2a-037e0801ed73 tempest-ProjectMemberTests-371943627 None] Lock "cinder-a5b22d51-1030-437b-9c53-fd192d4e0d2f-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (b0e84f68-1319-4b4f-8fc1-53c3e1f07968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207781c2-f559-41e9-bdb1-696ac7d42d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207781c2-f559-41e9-bdb1-696ac7d42d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-837965281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435b9413-9195-4507-99ad-11432d5aec00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:22Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e691e4c-b91e-4283-9662-c69bf2e8af34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e691e4c-b91e-4283-9662-c69bf2e8af34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f146e1-1028-40a0-9613-62bd05275171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f146e1-1028-40a0-9613-62bd05275171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '435b9413-9195-4507-99ad-11432d5aec00', 'volume_name': 'volume-435b9413-9195-4507-99ad-11432d5aec00', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955ab59a-08aa-47ae-99d7-f6bd3bf17c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955ab59a-08aa-47ae-99d7-f6bd3bf17c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55705064-0147-4548-85f3-9138ff9ea17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:21 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Volume 435b9413-9195-4507-99ad-11432d5aec00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-435b9413-9195-4507-99ad-11432d5aec00', 'volume_size': 1} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-837965281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435b9413-9195-4507-99ad-11432d5aec00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:22Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Creating volume 435b9413-9195-4507-99ad-11432d5aec00 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:21 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:21:22 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:21:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:22 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00 1073741824 Sep 03 20:21:22 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:22 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00 1073741824" returned: 0 in 0.439s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:22 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00 Sep 03 20:21:22 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:22 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00" returned: 0 in 0.287s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:22 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:21:22 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55705064-0147-4548-85f3-9138ff9ea17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-435b9413-9195-4507-99ad-11432d5aec00', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ab647b-f62e-486c-b3ec-c81da26e6c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:22 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Volume volume-435b9413-9195-4507-99ad-11432d5aec00 (435b9413-9195-4507-99ad-11432d5aec00): created successfully Sep 03 20:21:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ab647b-f62e-486c-b3ec-c81da26e6c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:22 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (b0e84f68-1319-4b4f-8fc1-53c3e1f07968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:22 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ebfcd548-72b2-4455-bdf1-dc5e98239ea2 tempest-ProjectMemberTests-371943627 None] Created volume successfully. Sep 03 20:21:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] Creating offline snapshot a977f60c-9110-432c-a9c6-5f72e4a54b14 of volume 435b9413-9195-4507-99ad-11432d5aec00 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:21:24 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f3c446-5af6-41ed-b4bf-ad0e4f281f78]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:24 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00 Sep 03 20:21:24 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:24 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00" returned: 0 in 0.365s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:24 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 1G Sep 03 20:21:24 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:25 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 1G" returned: 0 in 0.433s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-435b9413-9195-4507-99ad-11432d5aec00 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:25 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-435b9413-9195-4507-99ad-11432d5aec00 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 Sep 03 20:21:25 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:25 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-435b9413-9195-4507-99ad-11432d5aec00 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14" returned: 0 in 0.294s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:25 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 is being set with open permissions: ugo+rw Sep 03 20:21:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:25 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 Sep 03 20:21:25 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:25 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14" returned: 0 in 0.302s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:25 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.info Sep 03 20:21:25 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:25 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.info" returned: 0 in 0.256s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:25 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.info is being set with open permissions: ugo+rw Sep 03 20:21:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:25 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.info Sep 03 20:21:25 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:26 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.info" returned: 0 in 0.230s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.971s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:26 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ca1b573e-e5e1-4d3a-ba41-1366fed85be1 tempest-ProjectMemberTests-371943627 None] Create snapshot completed successfully Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-a977f60c-9110-432c-a9c6-5f72e4a54b14-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Lock "cinder-a977f60c-9110-432c-a9c6-5f72e4a54b14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-435b9413-9195-4507-99ad-11432d5aec00" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-435b9413-9195-4507-99ad-11432d5aec00" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-a977f60c-9110-432c-a9c6-5f72e4a54b14" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-a977f60c-9110-432c-a9c6-5f72e4a54b14" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Deleting offline snapshot a977f60c-9110-432c-a9c6-5f72e4a54b14 of volume 435b9413-9195-4507-99ad-11432d5aec00 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] snapshot_file for this snap is: volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[43861d26-1743-409e-b393-dc84de63e564]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:26 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 Sep 03 20:21:26 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:26 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14" returned: 0 in 0.422s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-435b9413-9195-4507-99ad-11432d5aec00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b88bbbf-7941-4b25-935b-62b5045fae7c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:26 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00 Sep 03 20:21:26 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:27 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00" returned: 0 in 0.350s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:27 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 Sep 03 20:21:27 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:27 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14" returned: 0 in 0.375s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:27 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14 Sep 03 20:21:27 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:27 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00.a977f60c-9110-432c-a9c6-5f72e4a54b14" returned: 0 in 0.274s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-a977f60c-9110-432c-a9c6-5f72e4a54b14" released by "_delete_snapshot" :: held 1.509s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-435b9413-9195-4507-99ad-11432d5aec00" released by "delete_snapshot" :: held 1.531s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:27 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:INSERT=46,cinder:UPDATE=180,cinder:SELECT=123,cinder:DELETE=16 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:21:27 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Created reservations ['fc40221a-d2d1-49fd-bdf4-1ec9eb67b5bc', '624ccded-101f-48b0-abd4-9ad2562ec40a', 'a0d7758d-cb37-420a-b9ac-0656c9d61a7e', 'eddfca65-bf7d-4a65-9b82-39ba94b14f7f'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:28 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Delete snapshot completed successfully. Sep 03 20:21:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-82502de0-bcf5-402c-9d00-c7b0118a899f tempest-ProjectMemberTests-371943627 None] Lock "cinder-a977f60c-9110-432c-a9c6-5f72e4a54b14-delete_snapshot" released by "delete_snapshot" :: held 1.683s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-435b9413-9195-4507-99ad-11432d5aec00-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Lock "cinder-435b9413-9195-4507-99ad-11432d5aec00-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-435b9413-9195-4507-99ad-11432d5aec00" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:28 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-435b9413-9195-4507-99ad-11432d5aec00" acquired by "delete_volume" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:28 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7090522c-7a24-4dd5-9301-957db3e19b17]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:28 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00 Sep 03 20:21:28 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:29 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00" returned: 0 in 0.409s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:29 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00 Sep 03 20:21:29 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:29 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-435b9413-9195-4507-99ad-11432d5aec00" returned: 0 in 0.280s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-435b9413-9195-4507-99ad-11432d5aec00" released by "delete_volume" :: held 0.743s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=140,cinder:UPDATE=176,cinder:INSERT=49,cinder:DELETE=14 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Created reservations ['e9be3afd-9dcc-45bc-a13e-93a04bb53d51', 'bc540aec-26e7-4301-afbc-b752f16670d5', 'ff438078-8965-49f9-9b45-99435acd20e2', 'e873b65c-18a9-405d-ab38-08127e5fd13d'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:29 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:21:29 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:29 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.254s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:21:29 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Deleted volume successfully. Sep 03 20:21:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-a7c1dd0a-012f-458d-a304-22e4efdfdcc5 tempest-ProjectMemberTests-371943627 None] Lock "cinder-435b9413-9195-4507-99ad-11432d5aec00-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (07b09256-f29a-4131-9e5a-c2a0f0c969c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c179d79-bd8c-47f5-8fb0-5d31c8acc7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c179d79-bd8c-47f5-8fb0-5d31c8acc7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-87826240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7614308e-7911-4ab4-b586-d3e122ddec67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:30Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ac5ba8-7e29-47de-bc76-94d89073215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ac5ba8-7e29-47de-bc76-94d89073215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5a38a0-4d6f-438d-8880-b3b46c6de635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5a38a0-4d6f-438d-8880-b3b46c6de635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7614308e-7911-4ab4-b586-d3e122ddec67', 'volume_name': 'volume-7614308e-7911-4ab4-b586-d3e122ddec67', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4984f6a9-ec17-4d2f-ac20-5bb43cc4b987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4984f6a9-ec17-4d2f-ac20-5bb43cc4b987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba11b8c-cc70-4982-94fe-fd9527c38ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:30 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Volume 7614308e-7911-4ab4-b586-d3e122ddec67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7614308e-7911-4ab4-b586-d3e122ddec67', 'volume_size': 1} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-87826240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7614308e-7911-4ab4-b586-d3e122ddec67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02f09a4435684cf09a61ab792a6ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:30Z,use_quota=True,user_id='d9f1281ebf0d44089d5311d91649ab9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Creating volume 7614308e-7911-4ab4-b586-d3e122ddec67 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:21:30 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:30 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67 1073741824 Sep 03 20:21:30 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:30 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67 1073741824" returned: 0 in 0.398s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:30 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67 Sep 03 20:21:30 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:30 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67" returned: 0 in 0.249s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba11b8c-cc70-4982-94fe-fd9527c38ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7614308e-7911-4ab4-b586-d3e122ddec67', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cf456f-57a2-4605-8b43-3c2325bc6c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:30 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Volume volume-7614308e-7911-4ab4-b586-d3e122ddec67 (7614308e-7911-4ab4-b586-d3e122ddec67): created successfully Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cf456f-57a2-4605-8b43-3c2325bc6c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:30 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Flow 'volume_create_manager' (07b09256-f29a-4131-9e5a-c2a0f0c969c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:31 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-aa75e37f-062a-4666-a021-39f6c1cc0335 tempest-ProjectMemberTests-371943627 None] Created volume successfully. Sep 03 20:21:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] Creating offline snapshot 9c13178d-756d-4605-931e-b7e647d3bdee of volume 7614308e-7911-4ab4-b586-d3e122ddec67 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:21:31 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b31da02-a325-42fd-b789-e85ce90c4589]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:31 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67 Sep 03 20:21:31 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:31 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67" returned: 0 in 0.349s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:31 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee 1G Sep 03 20:21:31 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:32 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee 1G" returned: 0 in 0.370s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7614308e-7911-4ab4-b586-d3e122ddec67 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:32 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7614308e-7911-4ab4-b586-d3e122ddec67 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee Sep 03 20:21:32 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:32 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7614308e-7911-4ab4-b586-d3e122ddec67 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee" returned: 0 in 0.293s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:32 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee is being set with open permissions: ugo+rw Sep 03 20:21:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:32 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee Sep 03 20:21:32 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:32 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee" returned: 0 in 0.240s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:32 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.info Sep 03 20:21:32 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:32 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.info" returned: 0 in 0.247s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:32 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.info is being set with open permissions: ugo+rw Sep 03 20:21:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:32 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.info Sep 03 20:21:32 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:33 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.info" returned: 0 in 0.235s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:33 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b0ad7727-091b-4cff-befc-61090ba1a4b1 tempest-ProjectMemberTests-371943627 None] Create snapshot completed successfully Sep 03 20:21:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-9c13178d-756d-4605-931e-b7e647d3bdee-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Lock "cinder-9c13178d-756d-4605-931e-b7e647d3bdee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-7614308e-7911-4ab4-b586-d3e122ddec67" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-7614308e-7911-4ab4-b586-d3e122ddec67" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-9c13178d-756d-4605-931e-b7e647d3bdee" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-9c13178d-756d-4605-931e-b7e647d3bdee" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Deleting offline snapshot 9c13178d-756d-4605-931e-b7e647d3bdee of volume 7614308e-7911-4ab4-b586-d3e122ddec67 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:21:33 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] snapshot_file for this snap is: volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:21:33 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fb1c3d-7f57-41a1-bfb7-9bbded254604]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:33 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee Sep 03 20:21:33 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:34 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee" returned: 0 in 0.340s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:34 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7614308e-7911-4ab4-b586-d3e122ddec67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:21:34 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0c8450-10c5-4cc7-8cd5-ca52e6cee6a8]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:34 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67 Sep 03 20:21:34 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:34 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67" returned: 0 in 0.347s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:34 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee Sep 03 20:21:34 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:34 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee" returned: 0 in 0.332s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:34 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee Sep 03 20:21:34 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:34 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:34 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67.9c13178d-756d-4605-931e-b7e647d3bdee" returned: 0 in 0.246s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:34 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-9c13178d-756d-4605-931e-b7e647d3bdee" released by "_delete_snapshot" :: held 1.349s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-7614308e-7911-4ab4-b586-d3e122ddec67" released by "delete_snapshot" :: held 1.369s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:35 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Created reservations ['96e12d55-ed33-4f98-ac09-43068ac3c65a', 'ec7114c7-0f73-4bd7-9eb9-46dc1fe5a469', '91140d0c-73c0-4d71-b79b-f8c36c0b69df', '29c0a612-6e97-4caf-a3c8-386c86eff01f'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:35 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Delete snapshot completed successfully. Sep 03 20:21:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d6d7170b-dce7-4851-bcff-8a73c5d9b43f tempest-ProjectMemberTests-371943627 None] Lock "cinder-9c13178d-756d-4605-931e-b7e647d3bdee-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-7614308e-7911-4ab4-b586-d3e122ddec67-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Lock "cinder-7614308e-7911-4ab4-b586-d3e122ddec67-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Acquiring lock "cinder-quobyte-7614308e-7911-4ab4-b586-d3e122ddec67" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:35 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-7614308e-7911-4ab4-b586-d3e122ddec67" acquired by "delete_volume" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:35 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[772ca346-51cd-40ee-b789-709943faecb0]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:35 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:36 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67 Sep 03 20:21:36 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:36 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67" returned: 0 in 0.355s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:36 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67 Sep 03 20:21:36 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:36 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-7614308e-7911-4ab4-b586-d3e122ddec67" returned: 0 in 0.258s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Lock "cinder-quobyte-7614308e-7911-4ab4-b586-d3e122ddec67" released by "delete_volume" :: held 0.673s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Created reservations ['da7f1d3f-d410-4e09-8139-e5a9b572dc2a', '62f7c2fc-3c0f-421c-b8c0-bf6208361315', 'aa6ffdb1-dc44-4d83-b3d6-dd6dbc58684b', '34fb8f6b-c992-4667-a184-17b4f5285c64'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:36 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:21:36 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:36 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:21:36 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:36 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.248s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:21:36 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Deleted volume successfully. Sep 03 20:21:36 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8c2df771-aca5-446a-be8e-77b581fa2c4a tempest-ProjectMemberTests-371943627 None] Lock "cinder-7614308e-7911-4ab4-b586-d3e122ddec67-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:37 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:37 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.284s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:37 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:21:37 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:21:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 29 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:21:37 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Flow 'volume_create_manager' (b3f214cd-f3fc-4a98-8045-6084c7dc125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b62ffa1-8248-4a25-8896-12efddb10a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b62ffa1-8248-4a25-8896-12efddb10a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-14985820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed72e52-58d5-4a12-99a6-996584f52176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030e21c9a87647508bbd7fc48e5193d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:40Z,use_quota=True,user_id='2394cc78da384f31afd3e07465cd04a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38185109-76d5-4763-969b-2f1bb85d43f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38185109-76d5-4763-969b-2f1bb85d43f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4be6e94-5ec1-455b-bbdd-04abe333e4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4be6e94-5ec1-455b-bbdd-04abe333e4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ed72e52-58d5-4a12-99a6-996584f52176', 'volume_name': 'volume-6ed72e52-58d5-4a12-99a6-996584f52176', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6214c080-5de4-4b9c-8c06-64f06a8d1e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6214c080-5de4-4b9c-8c06-64f06a8d1e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7289853e-a731-433e-ab56-a7842253a693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:40 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Volume 6ed72e52-58d5-4a12-99a6-996584f52176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ed72e52-58d5-4a12-99a6-996584f52176', 'volume_size': 1} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-14985820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed72e52-58d5-4a12-99a6-996584f52176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030e21c9a87647508bbd7fc48e5193d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:40Z,use_quota=True,user_id='2394cc78da384f31afd3e07465cd04a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Creating volume 6ed72e52-58d5-4a12-99a6-996584f52176 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:21:40 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:40 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176 1073741824 Sep 03 20:21:40 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:40 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:40 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176 1073741824" returned: 0 in 0.379s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:41 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176 Sep 03 20:21:41 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:41 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176" returned: 0 in 0.226s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] <== create_volume: return (644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:21:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.646s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7289853e-a731-433e-ab56-a7842253a693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed72e52-58d5-4a12-99a6-996584f52176', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de80b34e-ff36-4205-b816-f8bf51ea18df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:41 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Volume volume-6ed72e52-58d5-4a12-99a6-996584f52176 (6ed72e52-58d5-4a12-99a6-996584f52176): created successfully Sep 03 20:21:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de80b34e-ff36-4205-b816-f8bf51ea18df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:41 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Flow 'volume_create_manager' (b3f214cd-f3fc-4a98-8045-6084c7dc125c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:41 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-41ad8b68-563f-4a0d-8a07-07754394a8f5 tempest-ProjectReaderTests-58206778 None] Created volume successfully. Sep 03 20:21:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:41 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] Creating offline snapshot 09751e46-0566-4a07-b124-04534937f9d8 of volume 6ed72e52-58d5-4a12-99a6-996584f52176 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:21:41 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[0431f5a1-9181-4bc1-886a-ef0e32bda8dc]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:41 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:41 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176 Sep 03 20:21:41 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:42 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176" returned: 0 in 0.341s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:42 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 1G Sep 03 20:21:42 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:42 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 1G" returned: 0 in 0.362s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ed72e52-58d5-4a12-99a6-996584f52176 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:42 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ed72e52-58d5-4a12-99a6-996584f52176 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 Sep 03 20:21:42 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:42 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ed72e52-58d5-4a12-99a6-996584f52176 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8" returned: 0 in 0.264s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:42 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 is being set with open permissions: ugo+rw Sep 03 20:21:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:42 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 Sep 03 20:21:42 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:42 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8" returned: 0 in 0.233s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:42 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:42 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.info Sep 03 20:21:42 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:43 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.info" returned: 0 in 0.244s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:43 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.info is being set with open permissions: ugo+rw Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:43 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.info Sep 03 20:21:43 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:43 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.info" returned: 0 in 0.229s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.743s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:43 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d2b9f32f-54a5-4fed-8ece-52e2f0c94571 tempest-ProjectReaderTests-58206778 None] Create snapshot completed successfully Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-09751e46-0566-4a07-b124-04534937f9d8-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Lock "cinder-09751e46-0566-4a07-b124-04534937f9d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-6ed72e52-58d5-4a12-99a6-996584f52176" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-6ed72e52-58d5-4a12-99a6-996584f52176" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-09751e46-0566-4a07-b124-04534937f9d8" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-09751e46-0566-4a07-b124-04534937f9d8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Deleting offline snapshot 09751e46-0566-4a07-b124-04534937f9d8 of volume 6ed72e52-58d5-4a12-99a6-996584f52176 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] snapshot_file for this snap is: volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12feb05-f808-4c68-b9df-4f8a07f19e8b]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:43 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:44 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 Sep 03 20:21:44 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:44 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8" returned: 0 in 0.363s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:44 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ed72e52-58d5-4a12-99a6-996584f52176(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:21:44 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[7121b0b4-bbad-4ae7-85bc-51724a67e09f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:44 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176 Sep 03 20:21:44 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:44 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176" returned: 0 in 0.352s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:44 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:44 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 Sep 03 20:21:44 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:45 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8" returned: 0 in 0.314s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:45 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8 Sep 03 20:21:45 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:45 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:45 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176.09751e46-0566-4a07-b124-04534937f9d8" returned: 0 in 0.231s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-09751e46-0566-4a07-b124-04534937f9d8" released by "_delete_snapshot" :: held 1.345s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-6ed72e52-58d5-4a12-99a6-996584f52176" released by "delete_snapshot" :: held 1.366s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:45 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Created reservations ['e295fe1d-e095-4550-a1d2-bdb0356904dc', '7c5ecc9a-2d4d-473a-ad5c-d41c0e3079ca', '8a794734-5f70-4903-bc7e-d28b9ab80f7d', '87d52fd5-848d-426c-8a4f-c647f40610fa'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:45 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Delete snapshot completed successfully. Sep 03 20:21:45 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-592a2365-778d-4913-a7ce-e6c1346035e1 tempest-ProjectReaderTests-58206778 None] Lock "cinder-09751e46-0566-4a07-b124-04534937f9d8-delete_snapshot" released by "delete_snapshot" :: held 1.499s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-6ed72e52-58d5-4a12-99a6-996584f52176-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Lock "cinder-6ed72e52-58d5-4a12-99a6-996584f52176-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-6ed72e52-58d5-4a12-99a6-996584f52176" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-6ed72e52-58d5-4a12-99a6-996584f52176" acquired by "delete_volume" :: waited 0.014s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4882e2-bbf9-4f67-b86a-35d44d436915]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:46 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176 Sep 03 20:21:46 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:46 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176" returned: 0 in 0.372s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:46 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176 Sep 03 20:21:46 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:46 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-6ed72e52-58d5-4a12-99a6-996584f52176" returned: 0 in 0.232s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-6ed72e52-58d5-4a12-99a6-996584f52176" released by "delete_volume" :: held 0.664s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Created reservations ['f4cd9e1b-438f-4bc9-a484-db87eba0f1b8', '96a031ab-f55e-47b1-b6c1-eb8187474433', 'aea022fe-2efb-49dd-bc28-025b05ad010f', '6a95a56b-c7c9-4d9a-a85c-bccf3817e1c0'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:46 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:46 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:21:46 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:47 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.247s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:21:47 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Deleted volume successfully. Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-1fb48430-daf8-4344-88f6-b818af0fbe4e tempest-ProjectReaderTests-58206778 None] Lock "cinder-6ed72e52-58d5-4a12-99a6-996584f52176-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Flow 'volume_create_manager' (b6e5c716-c7ef-4da0-8b56-b2a48933b653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ae6607-ff21-484e-957b-2e7f703fb79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ae6607-ff21-484e-957b-2e7f703fb79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1079691438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8638e7-67d1-4465-8f34-e0634efdf07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030e21c9a87647508bbd7fc48e5193d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:48Z,use_quota=True,user_id='2394cc78da384f31afd3e07465cd04a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa22a23-f29f-4b5d-8dfa-42380f543d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa22a23-f29f-4b5d-8dfa-42380f543d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f766a3-ede4-45ce-915b-c648ca0d1db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f766a3-ede4-45ce-915b-c648ca0d1db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8638e7-67d1-4465-8f34-e0634efdf07c', 'volume_name': 'volume-3d8638e7-67d1-4465-8f34-e0634efdf07c', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c679c3-0814-4287-a021-9c3132645989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c679c3-0814-4287-a021-9c3132645989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7d03e9-42b9-4076-b5b9-5de9324bd52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:47 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Volume 3d8638e7-67d1-4465-8f34-e0634efdf07c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8638e7-67d1-4465-8f34-e0634efdf07c', 'volume_size': 1} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1079691438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8638e7-67d1-4465-8f34-e0634efdf07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030e21c9a87647508bbd7fc48e5193d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:48Z,use_quota=True,user_id='2394cc78da384f31afd3e07465cd04a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Creating volume 3d8638e7-67d1-4465-8f34-e0634efdf07c {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:21:47 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:21:47 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:47 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c 1073741824 Sep 03 20:21:47 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:48 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c 1073741824" returned: 0 in 0.393s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:48 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c Sep 03 20:21:48 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:48 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c" returned: 0 in 0.258s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7d03e9-42b9-4076-b5b9-5de9324bd52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8638e7-67d1-4465-8f34-e0634efdf07c', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2696d85-e1ae-4c3c-9c5a-f07395547da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:48 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Volume volume-3d8638e7-67d1-4465-8f34-e0634efdf07c (3d8638e7-67d1-4465-8f34-e0634efdf07c): created successfully Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2696d85-e1ae-4c3c-9c5a-f07395547da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Flow 'volume_create_manager' (b6e5c716-c7ef-4da0-8b56-b2a48933b653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:48 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-b0ab953a-180b-4224-b271-8602410d09c2 tempest-ProjectReaderTests-58206778 None] Created volume successfully. Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] Creating offline snapshot 6aa110c7-a054-4f47-825d-840357e229ed of volume 3d8638e7-67d1-4465-8f34-e0634efdf07c {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[37656571-caa2-48d6-b0b7-2076faf4b5ff]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:48 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:48 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c Sep 03 20:21:48 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:49 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c" returned: 0 in 0.364s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:49 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed 1G Sep 03 20:21:49 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:49 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed 1G" returned: 0 in 0.391s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8638e7-67d1-4465-8f34-e0634efdf07c -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:49 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8638e7-67d1-4465-8f34-e0634efdf07c -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed Sep 03 20:21:49 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:49 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8638e7-67d1-4465-8f34-e0634efdf07c -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed" returned: 0 in 0.314s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:49 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed is being set with open permissions: ugo+rw Sep 03 20:21:49 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:49 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed Sep 03 20:21:49 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:50 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed" returned: 0 in 0.254s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:50 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.info Sep 03 20:21:50 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:50 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.info" returned: 0 in 0.247s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:50 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.info is being set with open permissions: ugo+rw Sep 03 20:21:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:50 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.info Sep 03 20:21:50 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:50 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.info" returned: 0 in 0.232s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:50 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:50 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-7bb757e2-85a1-4921-ba0f-6262e525f4be tempest-ProjectReaderTests-58206778 None] Create snapshot completed successfully Sep 03 20:21:50 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-6aa110c7-a054-4f47-825d-840357e229ed-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Lock "cinder-6aa110c7-a054-4f47-825d-840357e229ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-3d8638e7-67d1-4465-8f34-e0634efdf07c" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-3d8638e7-67d1-4465-8f34-e0634efdf07c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-6aa110c7-a054-4f47-825d-840357e229ed" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-6aa110c7-a054-4f47-825d-840357e229ed" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Deleting offline snapshot 6aa110c7-a054-4f47-825d-840357e229ed of volume 3d8638e7-67d1-4465-8f34-e0634efdf07c {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] snapshot_file for this snap is: volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dda8ab9-b457-4f9a-9a43-624295189787]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:51 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed Sep 03 20:21:51 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:51 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed" returned: 0 in 0.386s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8638e7-67d1-4465-8f34-e0634efdf07c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[966bf24e-5e36-4a84-8b63-554a16a80b15]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:51 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c Sep 03 20:21:51 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:51 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c" returned: 0 in 0.408s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:51 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:51 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed Sep 03 20:21:51 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:52 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed" returned: 0 in 0.347s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:52 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed Sep 03 20:21:52 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:52 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:52 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c.6aa110c7-a054-4f47-825d-840357e229ed" returned: 0 in 0.270s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-6aa110c7-a054-4f47-825d-840357e229ed" released by "_delete_snapshot" :: held 1.510s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-3d8638e7-67d1-4465-8f34-e0634efdf07c" released by "delete_snapshot" :: held 1.539s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:52 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Created reservations ['f46004d2-b808-4528-97b5-bf44525881eb', '7d66df4a-c93d-456c-9fd6-4824bc32c7f5', 'd1ce5d82-7126-4085-bb72-d0444b5686e5', 'b8f14f6f-7fa0-42ed-8938-597f2e32c175'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:52 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Delete snapshot completed successfully. Sep 03 20:21:52 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-3fd4d020-b479-428a-a7a6-0c581b927e6b tempest-ProjectReaderTests-58206778 None] Lock "cinder-6aa110c7-a054-4f47-825d-840357e229ed-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-3d8638e7-67d1-4465-8f34-e0634efdf07c-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Lock "cinder-3d8638e7-67d1-4465-8f34-e0634efdf07c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-3d8638e7-67d1-4465-8f34-e0634efdf07c" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-3d8638e7-67d1-4465-8f34-e0634efdf07c" acquired by "delete_volume" :: waited 0.014s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:53 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc2246a-b762-4b70-a238-40ea96742fc8]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:53 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c Sep 03 20:21:53 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:53 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c" returned: 0 in 0.368s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:53 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c Sep 03 20:21:53 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:53 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:53 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3d8638e7-67d1-4465-8f34-e0634efdf07c" returned: 0 in 0.239s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:53 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-3d8638e7-67d1-4465-8f34-e0634efdf07c" released by "delete_volume" :: held 0.662s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:53 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Created reservations ['e1e59cc0-9cc4-4c99-8a4f-828c2af4f50a', '3f961b43-29e4-4d06-8cad-dcc6b006d3c7', '5756108e-45cc-42fb-961c-cac810d6d5e6', 'cfd25f72-4747-414e-9a2e-57c2b08b5aca'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:54 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:21:54 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:54 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.236s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:21:54 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Deleted volume successfully. Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-763aee5f-df6f-4411-b089-4d86e68e2147 tempest-ProjectReaderTests-58206778 None] Lock "cinder-3d8638e7-67d1-4465-8f34-e0634efdf07c-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Flow 'volume_create_manager' (ae54e11d-588a-445b-89f6-cdb71b3af237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f330ca68-7540-4aaa-ad3f-7061a99fe1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f330ca68-7540-4aaa-ad3f-7061a99fe1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-73317824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee63f572-4047-4872-8255-e62bb3eeb839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030e21c9a87647508bbd7fc48e5193d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:55Z,use_quota=True,user_id='2394cc78da384f31afd3e07465cd04a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4619fc-edd0-4061-8b87-53f87b7b947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4619fc-edd0-4061-8b87-53f87b7b947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60286a03-e0d4-43ec-81a2-9253c3f580a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60286a03-e0d4-43ec-81a2-9253c3f580a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee63f572-4047-4872-8255-e62bb3eeb839', 'volume_name': 'volume-ee63f572-4047-4872-8255-e62bb3eeb839', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f6d7e2-4fe8-447e-a0fd-b97b45e1955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f6d7e2-4fe8-447e-a0fd-b97b45e1955c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e50079-2f45-4d3b-a4b8-8eb18b965d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:54 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Volume ee63f572-4047-4872-8255-e62bb3eeb839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee63f572-4047-4872-8255-e62bb3eeb839', 'volume_size': 1} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-73317824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee63f572-4047-4872-8255-e62bb3eeb839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030e21c9a87647508bbd7fc48e5193d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:21:55Z,use_quota=True,user_id='2394cc78da384f31afd3e07465cd04a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Creating volume ee63f572-4047-4872-8255-e62bb3eeb839 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:21:54 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:21:54 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:54 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839 1073741824 Sep 03 20:21:54 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:55 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839 1073741824" returned: 0 in 0.409s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:55 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839 Sep 03 20:21:55 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:55 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839" returned: 0 in 0.239s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e50079-2f45-4d3b-a4b8-8eb18b965d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee63f572-4047-4872-8255-e62bb3eeb839', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975d4821-5cd2-476e-9e1a-f64536961b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:21:55 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Volume volume-ee63f572-4047-4872-8255-e62bb3eeb839 (ee63f572-4047-4872-8255-e62bb3eeb839): created successfully Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975d4821-5cd2-476e-9e1a-f64536961b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Flow 'volume_create_manager' (ae54e11d-588a-445b-89f6-cdb71b3af237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:21:55 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-472c599b-ea48-43dd-92b3-a46bb1320331 tempest-ProjectReaderTests-58206778 None] Created volume successfully. Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] Creating offline snapshot c0d74a27-42ea-462f-995e-90461211deb8 of volume ee63f572-4047-4872-8255-e62bb3eeb839 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3a62ca-8a2b-4408-9167-924f97f7d770]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:55 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:56 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839 Sep 03 20:21:56 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:56 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839" returned: 0 in 0.361s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:56 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 1G Sep 03 20:21:56 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:56 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 1G" returned: 0 in 0.401s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee63f572-4047-4872-8255-e62bb3eeb839 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:56 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee63f572-4047-4872-8255-e62bb3eeb839 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 Sep 03 20:21:56 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:56 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee63f572-4047-4872-8255-e62bb3eeb839 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8" returned: 0 in 0.277s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:56 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 is being set with open permissions: ugo+rw Sep 03 20:21:56 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:57 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 Sep 03 20:21:57 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:57 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8" returned: 0 in 0.240s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:57 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.info Sep 03 20:21:57 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:57 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.info" returned: 0 in 0.243s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:57 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.info is being set with open permissions: ugo+rw Sep 03 20:21:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:57 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.info Sep 03 20:21:57 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:57 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.info" returned: 0 in 0.237s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:57 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:21:57 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-4f421820-3622-4104-a2d1-7bf6b98ff7a0 tempest-ProjectReaderTests-58206778 None] Create snapshot completed successfully Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-c0d74a27-42ea-462f-995e-90461211deb8-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Lock "cinder-c0d74a27-42ea-462f-995e-90461211deb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-ee63f572-4047-4872-8255-e62bb3eeb839" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-ee63f572-4047-4872-8255-e62bb3eeb839" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-c0d74a27-42ea-462f-995e-90461211deb8" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-c0d74a27-42ea-462f-995e-90461211deb8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Deleting offline snapshot c0d74a27-42ea-462f-995e-90461211deb8 of volume ee63f572-4047-4872-8255-e62bb3eeb839 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] snapshot_file for this snap is: volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0ea293-5ce5-4924-8964-d1912eb6dee2]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:58 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 Sep 03 20:21:58 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:58 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8" returned: 0 in 0.368s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee63f572-4047-4872-8255-e62bb3eeb839(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5644b8e4-2245-4ee7-b9f2-718180118afc]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:58 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839 Sep 03 20:21:58 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:58 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839" returned: 0 in 0.352s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:58 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:58 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 Sep 03 20:21:58 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:59 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8" returned: 0 in 0.329s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:21:59 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8 Sep 03 20:21:59 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:21:59 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 03 20:21:59 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839.c0d74a27-42ea-462f-995e-90461211deb8" returned: 0 in 0.247s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:21:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-c0d74a27-42ea-462f-995e-90461211deb8" released by "_delete_snapshot" :: held 1.389s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-ee63f572-4047-4872-8255-e62bb3eeb839" released by "delete_snapshot" :: held 1.411s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:21:59 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Created reservations ['623aa6fc-75d8-47ab-8f4e-74c5369672ea', '1482b6bd-c121-4e4a-b76b-0625d75ab9f1', '4aa031cf-aa3a-4c0c-818e-b06abc955976', '643ffb31-23d4-42b5-be4d-82e930c92b16'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:21:59 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Delete snapshot completed successfully. Sep 03 20:21:59 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-8448444a-c7fe-434a-b9b5-7ebcda7d96a7 tempest-ProjectReaderTests-58206778 None] Lock "cinder-c0d74a27-42ea-462f-995e-90461211deb8-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-ee63f572-4047-4872-8255-e62bb3eeb839-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Lock "cinder-ee63f572-4047-4872-8255-e62bb3eeb839-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-ee63f572-4047-4872-8255-e62bb3eeb839" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-ee63f572-4047-4872-8255-e62bb3eeb839" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:00 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cfd5ae-592b-44f3-82fe-db5915a576ba]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:22:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:00 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839 Sep 03 20:22:00 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:00 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839" returned: 0 in 0.372s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:00 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839 Sep 03 20:22:00 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:00 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:00 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-ee63f572-4047-4872-8255-e62bb3eeb839" returned: 0 in 0.247s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:00 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-ee63f572-4047-4872-8255-e62bb3eeb839" released by "delete_volume" :: held 0.672s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Created reservations ['d8b43245-686b-4035-bc4c-683ec3ca10a2', 'e31a26ca-79ea-40b8-8198-561d7b2a1246', 'b83f4389-c55c-4d45-b36a-507ebde6dc1c', '88e4b874-8fd8-46b1-b91a-74acf9214e5b'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:01 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:22:01 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:01 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.252s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:22:01 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Deleted volume successfully. Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-d0531ac6-e49a-4cbe-98e7-07142933450c tempest-ProjectReaderTests-58206778 None] Lock "cinder-ee63f572-4047-4872-8255-e62bb3eeb839-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Flow 'volume_create_manager' (ac2ff5d7-900e-4918-9506-6ebd80d86822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fecb85a2-7a5e-474a-b90a-5bb82ab22767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fecb85a2-7a5e-474a-b90a-5bb82ab22767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1770025380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3986d7fc-a978-4883-bb78-f7bbcea04275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030e21c9a87647508bbd7fc48e5193d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:22:02Z,use_quota=True,user_id='2394cc78da384f31afd3e07465cd04a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f64839f-4846-4d24-a189-118c647c53f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f64839f-4846-4d24-a189-118c647c53f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa43d91-e78f-4557-9262-3ba2d42564e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa43d91-e78f-4557-9262-3ba2d42564e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3986d7fc-a978-4883-bb78-f7bbcea04275', 'volume_name': 'volume-3986d7fc-a978-4883-bb78-f7bbcea04275', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c1c4a5-8854-4f0f-9b2b-2a555d1536c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c1c4a5-8854-4f0f-9b2b-2a555d1536c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6c8dce-0769-45aa-a5b7-0242f423e4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:01 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Volume 3986d7fc-a978-4883-bb78-f7bbcea04275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3986d7fc-a978-4883-bb78-f7bbcea04275', 'volume_size': 1} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1770025380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3986d7fc-a978-4883-bb78-f7bbcea04275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030e21c9a87647508bbd7fc48e5193d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:22:02Z,use_quota=True,user_id='2394cc78da384f31afd3e07465cd04a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Creating volume 3986d7fc-a978-4883-bb78-f7bbcea04275 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:22:01 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:22:01 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:01 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275 1073741824 Sep 03 20:22:01 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:02 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275 1073741824" returned: 0 in 0.408s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:02 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275 Sep 03 20:22:02 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:02 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275" returned: 0 in 0.253s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:02 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:22:02 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6c8dce-0769-45aa-a5b7-0242f423e4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3986d7fc-a978-4883-bb78-f7bbcea04275', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7816a89f-d76c-4e25-854f-8fa973d64512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:02 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Volume volume-3986d7fc-a978-4883-bb78-f7bbcea04275 (3986d7fc-a978-4883-bb78-f7bbcea04275): created successfully Sep 03 20:22:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7816a89f-d76c-4e25-854f-8fa973d64512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:02 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Flow 'volume_create_manager' (ac2ff5d7-900e-4918-9506-6ebd80d86822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:22:02 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-4c821c01-b273-4ca9-9967-a2a5b943b4a5 tempest-ProjectReaderTests-58206778 None] Created volume successfully. Sep 03 20:22:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:03 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] Creating offline snapshot d7768e3c-91cb-46bf-a2a3-1748ca9d25fc of volume 3986d7fc-a978-4883-bb78-f7bbcea04275 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:22:03 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec511e8b-8ddc-46ff-96be-2ce95cc9735a]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:22:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:03 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275 Sep 03 20:22:03 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:03 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275" returned: 0 in 0.360s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:03 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc 1G Sep 03 20:22:03 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:03 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc 1G" returned: 0 in 0.387s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:03 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3986d7fc-a978-4883-bb78-f7bbcea04275 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:03 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3986d7fc-a978-4883-bb78-f7bbcea04275 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc Sep 03 20:22:03 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:04 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3986d7fc-a978-4883-bb78-f7bbcea04275 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc" returned: 0 in 0.282s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:04 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc is being set with open permissions: ugo+rw Sep 03 20:22:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:04 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc Sep 03 20:22:04 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:04 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc" returned: 0 in 0.260s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:04 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.info Sep 03 20:22:04 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:04 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.info" returned: 0 in 0.249s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:04 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.info is being set with open permissions: ugo+rw Sep 03 20:22:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:04 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.info Sep 03 20:22:04 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:04 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.info" returned: 0 in 0.234s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:04 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:04 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-11e7a60a-1fc7-48b8-b9db-1f9d3bef3969 tempest-ProjectReaderTests-58206778 None] Create snapshot completed successfully Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-d7768e3c-91cb-46bf-a2a3-1748ca9d25fc-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Lock "cinder-d7768e3c-91cb-46bf-a2a3-1748ca9d25fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-3986d7fc-a978-4883-bb78-f7bbcea04275" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-3986d7fc-a978-4883-bb78-f7bbcea04275" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-d7768e3c-91cb-46bf-a2a3-1748ca9d25fc" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-d7768e3c-91cb-46bf-a2a3-1748ca9d25fc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Deleting offline snapshot d7768e3c-91cb-46bf-a2a3-1748ca9d25fc of volume 3986d7fc-a978-4883-bb78-f7bbcea04275 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] snapshot_file for this snap is: volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c15458-5ce9-4f83-9c23-cbb88863727c]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:05 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc Sep 03 20:22:05 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:05 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc" returned: 0 in 0.362s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3986d7fc-a978-4883-bb78-f7bbcea04275(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55d6709-ee29-44ab-83d6-765099862cc0]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:05 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275 Sep 03 20:22:05 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:05 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275" returned: 0 in 0.377s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:05 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:06 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc Sep 03 20:22:06 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:06 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc" returned: 0 in 0.329s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:06 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc Sep 03 20:22:06 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:06 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:06 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275.d7768e3c-91cb-46bf-a2a3-1748ca9d25fc" returned: 0 in 0.261s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-d7768e3c-91cb-46bf-a2a3-1748ca9d25fc" released by "_delete_snapshot" :: held 1.417s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-3986d7fc-a978-4883-bb78-f7bbcea04275" released by "delete_snapshot" :: held 1.441s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:06 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Created reservations ['01d9c42e-4332-4df5-8c1a-d3f451ad4abc', '18d5aab9-4774-4843-b6b9-7f53202d2074', '8ef16d20-c19f-4d85-af0b-4aed2842f775', '1c7f909f-2b9c-40b7-8130-52d492ebe374'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:22:06 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Delete snapshot completed successfully. Sep 03 20:22:06 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-e0dc3d97-6c44-42ba-8fc9-be1792f8dfbc tempest-ProjectReaderTests-58206778 None] Lock "cinder-d7768e3c-91cb-46bf-a2a3-1748ca9d25fc-delete_snapshot" released by "delete_snapshot" :: held 1.581s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-3986d7fc-a978-4883-bb78-f7bbcea04275-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Lock "cinder-3986d7fc-a978-4883-bb78-f7bbcea04275-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-3986d7fc-a978-4883-bb78-f7bbcea04275" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:07 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-3986d7fc-a978-4883-bb78-f7bbcea04275" acquired by "delete_volume" :: waited 0.014s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:07 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1659e3-4481-468b-a5b8-22543c9893ad]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:22:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:07 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275 Sep 03 20:22:07 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:07 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275" returned: 0 in 0.352s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:07 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275 Sep 03 20:22:07 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:07 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:07 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-3986d7fc-a978-4883-bb78-f7bbcea04275" returned: 0 in 0.245s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-3986d7fc-a978-4883-bb78-f7bbcea04275" released by "delete_volume" :: held 0.650s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Created reservations ['0ce60b8e-0422-4186-a6b0-334d905cd029', '6ca4e7da-c1c8-4711-8e06-9e6da8348a0b', '9327085d-80d8-4218-a3fe-a2a0c9892b72', '526b5d4d-4329-420e-8318-c7966bf94aad'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:08 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:22:08 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:08 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.255s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:22:08 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Deleted volume successfully. Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-125b8ce7-ae4c-4640-aa29-d52efdb0860a tempest-ProjectReaderTests-58206778 None] Lock "cinder-3986d7fc-a978-4883-bb78-f7bbcea04275-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Flow 'volume_create_manager' (607d5703-9376-4f29-bdee-c084d20fad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d2cccb-9393-4851-86b3-4b6da504a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d2cccb-9393-4851-86b3-4b6da504a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1150188703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb457471-8986-4f66-8cfc-9a4e3adc6629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030e21c9a87647508bbd7fc48e5193d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:22:09Z,use_quota=True,user_id='2394cc78da384f31afd3e07465cd04a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9369dd-8477-45a6-9b00-4846e70674de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9369dd-8477-45a6-9b00-4846e70674de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237dd825-bbfa-40b5-a049-3d95ea0672f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237dd825-bbfa-40b5-a049-3d95ea0672f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb457471-8986-4f66-8cfc-9a4e3adc6629', 'volume_name': 'volume-cb457471-8986-4f66-8cfc-9a4e3adc6629', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefe800b-3a71-416a-bffa-1b4021562a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefe800b-3a71-416a-bffa-1b4021562a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b960432d-26c9-45d7-b843-60403def8a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:08 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Volume cb457471-8986-4f66-8cfc-9a4e3adc6629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb457471-8986-4f66-8cfc-9a4e3adc6629', 'volume_size': 1} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1150188703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb457471-8986-4f66-8cfc-9a4e3adc6629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030e21c9a87647508bbd7fc48e5193d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:22:09Z,use_quota=True,user_id='2394cc78da384f31afd3e07465cd04a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Creating volume cb457471-8986-4f66-8cfc-9a4e3adc6629 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:22:08 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:22:08 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:08 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 1073741824 Sep 03 20:22:08 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:09 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 1073741824" returned: 0 in 0.417s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:09 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 Sep 03 20:22:09 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:09 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629" returned: 0 in 0.248s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:09 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:22:09 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b960432d-26c9-45d7-b843-60403def8a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb457471-8986-4f66-8cfc-9a4e3adc6629', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c7b540-5581-4d8b-9a0c-8fb79a1fd3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:09 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Volume volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 (cb457471-8986-4f66-8cfc-9a4e3adc6629): created successfully Sep 03 20:22:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c7b540-5581-4d8b-9a0c-8fb79a1fd3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:09 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Flow 'volume_create_manager' (607d5703-9376-4f29-bdee-c084d20fad19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:22:09 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-5466cb64-1456-4e8e-b938-a7d2107b7bbc tempest-ProjectReaderTests-58206778 None] Created volume successfully. Sep 03 20:22:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:10 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] Creating offline snapshot 5f8be078-5443-487d-a38e-54648d2f7f06 of volume cb457471-8986-4f66-8cfc-9a4e3adc6629 {{(pid=87582) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 20:22:10 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[af654d37-d965-4dab-a023-ec85e24ec18a]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:22:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:10 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 Sep 03 20:22:10 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:10 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629" returned: 0 in 0.337s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 1G {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:10 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 1G Sep 03 20:22:10 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:10 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 1G" returned: 0 in 0.389s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:10 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:10 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 Sep 03 20:22:10 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:11 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 -F qcow2 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06" returned: 0 in 0.307s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:11 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 is being set with open permissions: ugo+rw Sep 03 20:22:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:11 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 Sep 03 20:22:11 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:11 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06" returned: 0 in 0.253s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:11 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.info Sep 03 20:22:11 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:11 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.info" returned: 0 in 0.251s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:11 devstack cinder-volume[87582]: WARNING cinder.volume.drivers.remotefs [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.info is being set with open permissions: ugo+rw Sep 03 20:22:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.info {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:11 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.info Sep 03 20:22:11 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:11 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.info" returned: 0 in 0.243s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:11 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:11 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-15510ea6-5c87-434e-a575-d2e3bdf975a4 tempest-ProjectReaderTests-58206778 None] Create snapshot completed successfully Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-5f8be078-5443-487d-a38e-54648d2f7f06-delete_snapshot" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Lock "cinder-5f8be078-5443-487d-a38e-54648d2f7f06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-cb457471-8986-4f66-8cfc-9a4e3adc6629" by "delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-cb457471-8986-4f66-8cfc-9a4e3adc6629" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-5f8be078-5443-487d-a38e-54648d2f7f06" by "_delete_snapshot" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-5f8be078-5443-487d-a38e-54648d2f7f06" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Deleting offline snapshot 5f8be078-5443-487d-a38e-54648d2f7f06 of volume cb457471-8986-4f66-8cfc-9a4e3adc6629 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] snapshot_file for this snap is: volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 {{(pid=87582) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[46850174-f5e9-4947-ba74-0809e60375c7]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:12 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 Sep 03 20:22:12 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:12 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06" returned: 0 in 0.368s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb457471-8986-4f66-8cfc-9a4e3adc6629(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87582) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[928d2f41-6712-47e9-a0e9-f2e9bf158e03]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:12 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 Sep 03 20:22:12 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:12 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629" returned: 0 in 0.345s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:12 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:13 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 Sep 03 20:22:13 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:13 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06" returned: 0 in 0.334s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:13 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06 Sep 03 20:22:13 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:13 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:13 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629.5f8be078-5443-487d-a38e-54648d2f7f06" returned: 0 in 0.236s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-5f8be078-5443-487d-a38e-54648d2f7f06" released by "_delete_snapshot" :: held 1.369s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-cb457471-8986-4f66-8cfc-9a4e3adc6629" released by "delete_snapshot" :: held 1.392s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:13 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Created reservations ['d3dea71c-455c-476e-b2f8-b3582006d523', 'ccb04356-012d-4977-9ed3-9c465da0c0df', '51e9de20-2f26-4e69-9051-7305019ef110', 'fae76ecc-19dc-4de1-b68e-5f8b39a153a7'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:22:13 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Delete snapshot completed successfully. Sep 03 20:22:13 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-2b2a0603-4bc0-4900-a04b-877c0664c61b tempest-ProjectReaderTests-58206778 None] Lock "cinder-5f8be078-5443-487d-a38e-54648d2f7f06-delete_snapshot" released by "delete_snapshot" :: held 1.516s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-cb457471-8986-4f66-8cfc-9a4e3adc6629-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Lock "cinder-cb457471-8986-4f66-8cfc-9a4e3adc6629-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Acquiring lock "cinder-quobyte-cb457471-8986-4f66-8cfc-9a4e3adc6629" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:14 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-cb457471-8986-4f66-8cfc-9a4e3adc6629" acquired by "delete_volume" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:14 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb7b6b-508f-4ed4-b1bb-061264b4cad0]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:22:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:14 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 Sep 03 20:22:14 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:14 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629" returned: 0 in 0.345s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:14 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:14 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629 Sep 03 20:22:14 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:15 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-cb457471-8986-4f66-8cfc-9a4e3adc6629" returned: 0 in 0.235s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Lock "cinder-quobyte-cb457471-8986-4f66-8cfc-9a4e3adc6629" released by "delete_volume" :: held 0.637s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:15 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Created reservations ['de884e53-bcc0-4aa2-9dca-2cc325382a48', '9ea50a98-af71-4df8-aa97-c749899903d7', 'a941f951-494f-4a89-b5ec-ebd070cb3a52', '7d7c61d6-1164-4c4b-bd72-7f9505ba7a1e'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:22:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:22:15 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:22:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:15 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:22:15 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:15 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:15 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.255s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:15 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:22:15 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Deleted volume successfully. Sep 03 20:22:15 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-56c7d0c5-153d-48d0-b8c5-79f71bf3b329 tempest-ProjectReaderTests-58206778 None] Lock "cinder-cb457471-8986-4f66-8cfc-9a4e3adc6629-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Flow 'volume_create_manager' (bd0dcfe1-5227-479d-8a3a-32076bb7d7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbb45e7-fb5f-419e-8529-8bd700ca464e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbb45e7-fb5f-419e-8529-8bd700ca464e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1944293971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a83ea76-1385-4a79-beb2-539efe2103a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f2770846824ee18ad37aadbf806d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:22:23Z,use_quota=True,user_id='2cc2e2b1ee9e4b42996ca6d4e453332f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76edbf0-f19c-498b-b078-8e67ccbc3770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76edbf0-f19c-498b-b078-8e67ccbc3770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612b66da-4cad-4fec-ae9a-d94a8c32f2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612b66da-4cad-4fec-ae9a-d94a8c32f2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a83ea76-1385-4a79-beb2-539efe2103a9', 'volume_name': 'volume-0a83ea76-1385-4a79-beb2-539efe2103a9', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccd51aa-9274-4d1e-ad90-984dd617892b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccd51aa-9274-4d1e-ad90-984dd617892b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c754468-e670-48fb-91bc-d79c4d4336fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:23 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Volume 0a83ea76-1385-4a79-beb2-539efe2103a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a83ea76-1385-4a79-beb2-539efe2103a9', 'volume_size': 1} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1944293971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a83ea76-1385-4a79-beb2-539efe2103a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f2770846824ee18ad37aadbf806d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:22:23Z,use_quota=True,user_id='2cc2e2b1ee9e4b42996ca6d4e453332f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Creating volume 0a83ea76-1385-4a79-beb2-539efe2103a9 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:22:23 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0a83ea76-1385-4a79-beb2-539efe2103a9 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:23 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0a83ea76-1385-4a79-beb2-539efe2103a9 1073741824 Sep 03 20:22:23 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:23 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0a83ea76-1385-4a79-beb2-539efe2103a9 1073741824" returned: 0 in 0.407s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0a83ea76-1385-4a79-beb2-539efe2103a9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:23 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0a83ea76-1385-4a79-beb2-539efe2103a9 Sep 03 20:22:23 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:23 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0a83ea76-1385-4a79-beb2-539efe2103a9" returned: 0 in 0.250s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c754468-e670-48fb-91bc-d79c4d4336fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a83ea76-1385-4a79-beb2-539efe2103a9', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65bddd3-6b02-4d2f-b6ce-6d43d7e46e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:23 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Volume volume-0a83ea76-1385-4a79-beb2-539efe2103a9 (0a83ea76-1385-4a79-beb2-539efe2103a9): created successfully Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65bddd3-6b02-4d2f-b6ce-6d43d7e46e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:23 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Flow 'volume_create_manager' (bd0dcfe1-5227-479d-8a3a-32076bb7d7d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:22:23 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-23fe1ddd-bdca-4929-8d9b-a3f7781b273f tempest-ProjectReaderTests-1596726514 None] Created volume successfully. Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Acquiring lock "cinder-0a83ea76-1385-4a79-beb2-539efe2103a9-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Lock "cinder-0a83ea76-1385-4a79-beb2-539efe2103a9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Acquiring lock "cinder-quobyte-0a83ea76-1385-4a79-beb2-539efe2103a9" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Lock "cinder-quobyte-0a83ea76-1385-4a79-beb2-539efe2103a9" acquired by "delete_volume" :: waited 0.014s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf666c2a-9ea3-4e13-9c45-bb11baa4efa7]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0a83ea76-1385-4a79-beb2-539efe2103a9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:24 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0a83ea76-1385-4a79-beb2-539efe2103a9 Sep 03 20:22:24 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:24 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0a83ea76-1385-4a79-beb2-539efe2103a9" returned: 0 in 0.348s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0a83ea76-1385-4a79-beb2-539efe2103a9 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:24 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0a83ea76-1385-4a79-beb2-539efe2103a9 Sep 03 20:22:24 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:24 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-0a83ea76-1385-4a79-beb2-539efe2103a9" returned: 0 in 0.232s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Lock "cinder-quobyte-0a83ea76-1385-4a79-beb2-539efe2103a9" released by "delete_volume" :: held 0.619s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Created reservations ['16729327-d06f-4183-a8d4-90b8dc72d7f7', '031d3fc1-8e94-4a4c-8362-76437d904fe5', '3698e8e9-6492-486b-8885-2a5b580d19d4', '7757b58c-59df-4388-ae3c-6259d1c6e55f'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:24 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:25 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:22:25 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:25 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.236s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:22:25 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Deleted volume successfully. Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-f776a45d-a4cf-40b8-9769-9bb168c0816b tempest-ProjectReaderTests-1596726514 None] Lock "cinder-0a83ea76-1385-4a79-beb2-539efe2103a9-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Flow 'volume_create_manager' (0c49d530-9900-41a5-b473-a97b2afe4759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d5e25e-c24b-41fe-8e9d-b237bdceea7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d5e25e-c24b-41fe-8e9d-b237bdceea7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1764472588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70081dc2-ad58-4dea-b1b7-4593e03621af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f2770846824ee18ad37aadbf806d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:22:26Z,use_quota=True,user_id='2cc2e2b1ee9e4b42996ca6d4e453332f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b015448-8677-4374-973e-f3b6e84f0405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b015448-8677-4374-973e-f3b6e84f0405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d652ca30-1d3f-4eac-af43-23e50c76ed17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d652ca30-1d3f-4eac-af43-23e50c76ed17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70081dc2-ad58-4dea-b1b7-4593e03621af', 'volume_name': 'volume-70081dc2-ad58-4dea-b1b7-4593e03621af', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2c2e5f-5e76-418c-be12-d4ae5ea5cb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2c2e5f-5e76-418c-be12-d4ae5ea5cb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c06cfee-4f12-4035-955a-47ad117b97ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:25 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Volume 70081dc2-ad58-4dea-b1b7-4593e03621af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70081dc2-ad58-4dea-b1b7-4593e03621af', 'volume_size': 1} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1764472588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70081dc2-ad58-4dea-b1b7-4593e03621af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f2770846824ee18ad37aadbf806d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:22:26Z,use_quota=True,user_id='2cc2e2b1ee9e4b42996ca6d4e453332f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Creating volume 70081dc2-ad58-4dea-b1b7-4593e03621af {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:22:25 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:22:25 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70081dc2-ad58-4dea-b1b7-4593e03621af 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:25 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70081dc2-ad58-4dea-b1b7-4593e03621af 1073741824 Sep 03 20:22:25 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:26 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70081dc2-ad58-4dea-b1b7-4593e03621af 1073741824" returned: 0 in 0.415s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70081dc2-ad58-4dea-b1b7-4593e03621af {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:26 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70081dc2-ad58-4dea-b1b7-4593e03621af Sep 03 20:22:26 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:26 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70081dc2-ad58-4dea-b1b7-4593e03621af" returned: 0 in 0.233s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c06cfee-4f12-4035-955a-47ad117b97ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70081dc2-ad58-4dea-b1b7-4593e03621af', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a5a8e1-d2a1-4a15-a4cc-f8d2087384fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:26 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Volume volume-70081dc2-ad58-4dea-b1b7-4593e03621af (70081dc2-ad58-4dea-b1b7-4593e03621af): created successfully Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a5a8e1-d2a1-4a15-a4cc-f8d2087384fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Flow 'volume_create_manager' (0c49d530-9900-41a5-b473-a97b2afe4759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:22:26 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-3ec04ab2-4781-4a5a-8cbe-23dfa0239cf2 tempest-ProjectReaderTests-1596726514 None] Created volume successfully. Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Acquiring lock "cinder-70081dc2-ad58-4dea-b1b7-4593e03621af-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Lock "cinder-70081dc2-ad58-4dea-b1b7-4593e03621af-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Acquiring lock "cinder-quobyte-70081dc2-ad58-4dea-b1b7-4593e03621af" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Lock "cinder-quobyte-70081dc2-ad58-4dea-b1b7-4593e03621af" acquired by "delete_volume" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1feea83-7fad-423c-95b7-b7499b728d6f]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:22:26 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70081dc2-ad58-4dea-b1b7-4593e03621af {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:27 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70081dc2-ad58-4dea-b1b7-4593e03621af Sep 03 20:22:27 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:27 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70081dc2-ad58-4dea-b1b7-4593e03621af" returned: 0 in 0.346s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70081dc2-ad58-4dea-b1b7-4593e03621af {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:27 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70081dc2-ad58-4dea-b1b7-4593e03621af Sep 03 20:22:27 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:27 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-70081dc2-ad58-4dea-b1b7-4593e03621af" returned: 0 in 0.244s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Lock "cinder-quobyte-70081dc2-ad58-4dea-b1b7-4593e03621af" released by "delete_volume" :: held 0.627s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Created reservations ['e073f512-7bc2-4414-81b5-27617f4a1573', '7d5fdd5c-7340-4b98-97e5-06f4ccf9d098', 'dd6ccaba-b738-467e-bbd8-20e47c6a4981', '6366ba67-216b-406b-ad5b-00386995e78e'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:27 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:22:27 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:27 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.241s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:22:27 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Deleted volume successfully. Sep 03 20:22:27 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-68b2a09e-0357-423d-931f-45a42a7950b2 tempest-ProjectReaderTests-1596726514 None] Lock "cinder-70081dc2-ad58-4dea-b1b7-4593e03621af-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Flow 'volume_create_manager' (b20ae242-76dc-44f5-91fa-bb217880c553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb3ac42-17d6-4e9c-8683-5228a8f48881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=111,cinder:INSERT=40,cinder:UPDATE=159,cinder:DELETE=14 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb3ac42-17d6-4e9c-8683-5228a8f48881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466213416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5209c646-221c-4524-a482-9d1320875480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f2770846824ee18ad37aadbf806d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:22:28Z,use_quota=True,user_id='2cc2e2b1ee9e4b42996ca6d4e453332f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8abccf-a510-49b4-aef7-201217f66227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8abccf-a510-49b4-aef7-201217f66227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8217e3-45ec-424d-b3f1-ca0f7326b6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8217e3-45ec-424d-b3f1-ca0f7326b6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5209c646-221c-4524-a482-9d1320875480', 'volume_name': 'volume-5209c646-221c-4524-a482-9d1320875480', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63950cc9-514e-4b41-8204-75bf09f7de86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63950cc9-514e-4b41-8204-75bf09f7de86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db3fbb5-96a1-4911-a908-5f104ca48a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:28 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Volume 5209c646-221c-4524-a482-9d1320875480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5209c646-221c-4524-a482-9d1320875480', 'volume_size': 1} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466213416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5209c646-221c-4524-a482-9d1320875480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f2770846824ee18ad37aadbf806d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:22:28Z,use_quota=True,user_id='2cc2e2b1ee9e4b42996ca6d4e453332f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Creating volume 5209c646-221c-4524-a482-9d1320875480 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:22:28 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5209c646-221c-4524-a482-9d1320875480 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:28 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5209c646-221c-4524-a482-9d1320875480 1073741824 Sep 03 20:22:28 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:28 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5209c646-221c-4524-a482-9d1320875480 1073741824" returned: 0 in 0.407s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:28 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5209c646-221c-4524-a482-9d1320875480 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:28 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5209c646-221c-4524-a482-9d1320875480 Sep 03 20:22:28 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:29 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5209c646-221c-4524-a482-9d1320875480" returned: 0 in 0.237s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db3fbb5-96a1-4911-a908-5f104ca48a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5209c646-221c-4524-a482-9d1320875480', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ff0105-7adf-4844-80d9-d69c7a8ebbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:29 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Volume volume-5209c646-221c-4524-a482-9d1320875480 (5209c646-221c-4524-a482-9d1320875480): created successfully Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ff0105-7adf-4844-80d9-d69c7a8ebbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Flow 'volume_create_manager' (b20ae242-76dc-44f5-91fa-bb217880c553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:22:29 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-14877ee2-73c0-4b01-ad61-74bd679f52ef tempest-ProjectReaderTests-1596726514 None] Created volume successfully. Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Acquiring lock "cinder-5209c646-221c-4524-a482-9d1320875480-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Lock "cinder-5209c646-221c-4524-a482-9d1320875480-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:INSERT=35,cinder:UPDATE=126,cinder:SELECT=102,cinder:DELETE=10 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Acquiring lock "cinder-quobyte-5209c646-221c-4524-a482-9d1320875480" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Lock "cinder-quobyte-5209c646-221c-4524-a482-9d1320875480" acquired by "delete_volume" :: waited 0.017s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[b828f9df-8f93-4094-96c1-fd74d15f5480]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5209c646-221c-4524-a482-9d1320875480 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:29 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5209c646-221c-4524-a482-9d1320875480 Sep 03 20:22:29 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:29 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5209c646-221c-4524-a482-9d1320875480" returned: 0 in 0.344s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:29 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5209c646-221c-4524-a482-9d1320875480 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:29 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5209c646-221c-4524-a482-9d1320875480 Sep 03 20:22:29 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:30 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-5209c646-221c-4524-a482-9d1320875480" returned: 0 in 0.244s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Lock "cinder-quobyte-5209c646-221c-4524-a482-9d1320875480" released by "delete_volume" :: held 0.622s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:30 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Created reservations ['e913ddc3-588a-432a-b331-88dcbde84a84', 'b349ac43-c423-451d-9b5f-b31263a8d407', '80f8fb89-d36c-4d5f-a00c-30991cc03b49', '914cf604-821e-48a1-bdee-d4e311190d1a'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:22:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:22:30 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:22:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:30 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:22:30 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:30 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:30 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.247s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:30 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:22:30 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Deleted volume successfully. Sep 03 20:22:30 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-9ffd571e-d0c6-4c61-b6df-1073893f9285 tempest-ProjectReaderTests-1596726514 None] Lock "cinder-5209c646-221c-4524-a482-9d1320875480-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87582) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Flow 'volume_create_manager' (3db22b57-a1f3-46c5-827d-2a5c944a721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28302979-2afb-40cb-80cd-9b41281203ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28302979-2afb-40cb-80cd-9b41281203ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957445235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3789225-8cd2-4e9a-b4a1-a87d7d99c540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f2770846824ee18ad37aadbf806d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:22:31Z,use_quota=True,user_id='2cc2e2b1ee9e4b42996ca6d4e453332f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8379b7d-59ec-4a0d-892c-9e605636b4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8379b7d-59ec-4a0d-892c-9e605636b4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f133c11-8685-4420-970b-505553f78c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f133c11-8685-4420-970b-505553f78c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3789225-8cd2-4e9a-b4a1-a87d7d99c540', 'volume_name': 'volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff84dcf0-354a-459e-80e1-42390b426b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff84dcf0-354a-459e-80e1-42390b426b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b466ee1a-6e25-46dd-8d03-25eefe3ab723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:31 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Volume e3789225-8cd2-4e9a-b4a1-a87d7d99c540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540', 'volume_size': 1} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T18:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957445235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3789225-8cd2-4e9a-b4a1-a87d7d99c540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f2770846824ee18ad37aadbf806d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T18:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T18:22:31Z,use_quota=True,user_id='2cc2e2b1ee9e4b42996ca6d4e453332f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51d44841-a096-422e-877f-9a24f875bea7),volume_type_id=51d44841-a096-422e-877f-9a24f875bea7)}" {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.remotefs [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Creating volume e3789225-8cd2-4e9a-b4a1-a87d7d99c540 {{(pid=87582) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Selected osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae as target Quobyte volume. {{(pid=87582) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 20:22:31 devstack cinder-volume[87582]: INFO cinder.volume.drivers.remotefs [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] casted to osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540 1073741824 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:31 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540 1073741824 Sep 03 20:22:31 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:31 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540 1073741824" returned: 0 in 0.404s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:31 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540 Sep 03 20:22:31 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:31 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540" returned: 0 in 0.240s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'} {{(pid=87582) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b466ee1a-6e25-46dd-8d03-25eefe3ab723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540', 'volume_size': 1}' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b193a9-f28c-47ed-8013-118e739d3e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 20:22:31 devstack cinder-volume[87582]: INFO cinder.volume.flows.manager.create_volume [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Volume volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540 (e3789225-8cd2-4e9a-b4a1-a87d7d99c540): created successfully Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b193a9-f28c-47ed-8013-118e739d3e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87582) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 20:22:31 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Flow 'volume_create_manager' (3db22b57-a1f3-46c5-827d-2a5c944a721d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87582) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 20:22:31 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-ad83f0a2-645e-4625-83f3-335ce42047e4 tempest-ProjectReaderTests-1596726514 None] Created volume successfully. Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Acquiring lock "cinder-e3789225-8cd2-4e9a-b4a1-a87d7d99c540-delete_volume" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Lock "cinder-e3789225-8cd2-4e9a-b4a1-a87d7d99c540-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Acquiring lock "cinder-quobyte-e3789225-8cd2-4e9a-b4a1-a87d7d99c540" by "delete_volume" {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Lock "cinder-quobyte-e3789225-8cd2-4e9a-b4a1-a87d7d99c540" acquired by "delete_volume" :: waited 0.013s {{(pid=87582) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG oslo.privsep.daemon [-] privsep: reply[362eb9ff-6725-463f-b5f5-834a3dc4fd33]: (4, 'qcow2') {{(pid=89028) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:32 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540 Sep 03 20:22:32 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:32 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540" returned: 0 in 0.343s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540 {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:32 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540 Sep 03 20:22:32 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:32 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf/volume-e3789225-8cd2-4e9a-b4a1-a87d7d99c540" returned: 0 in 0.233s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Lock "cinder-quobyte-e3789225-8cd2-4e9a-b4a1-a87d7d99c540" released by "delete_volume" :: held 0.611s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG cinder.quota [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Created reservations ['adccc4c9-1370-4baa-aaa6-93c833d467b2', '2184aa45-b844-4975-a210-5addc7848fe5', '371b61f1-bef5-482c-aed2-97454dd2a49d', '54c7d6f0-10b9-44b3-b5d4-0cdf2444d236'] {{(pid=87582) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae': None} {{(pid=87582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG cinder.volume.drivers.quobyte [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-960a223c-d0e7-448b-a946-22e4695319ae'] {{(pid=87582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.lockutils [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 20:22:32 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 20:22:32 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf Sep 03 20:22:32 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 20:22:33 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 03 20:22:33 devstack cinder-volume[87582]: DEBUG oslo_concurrency.processutils [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1db2df491aa5c3061da31bd823eadfdf" returned: 0 in 0.244s {{(pid=87582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 20:22:33 devstack cinder-volume[87582]: DEBUG cinder.manager [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Notifying Schedulers of capabilities ... {{(pid=87582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 20:22:33 devstack cinder-volume[87582]: INFO cinder.volume.manager [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Deleted volume successfully. Sep 03 20:22:33 devstack cinder-volume[87582]: DEBUG cinder.coordination [None req-968fd108-38d3-466e-be6e-85b5bcc94fcc tempest-ProjectReaderTests-1596726514 None] Lock "cinder-e3789225-8cd2-4e9a-b4a1-a87d7d99c540-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87582) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 20:22:36 devstack cinder-volume[87582]: DEBUG oslo_service.periodic_task [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] Running periodic task VolumeManager._thread_info {{(pid=87582) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 20:22:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread count: 29 {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 20:22:36 devstack cinder-volume[87582]: DEBUG cinder.volume.manager [None req-7b0d544d-159f-40cc-90fc-38a0cbe902a5 None None] thread info: [<_MainThread(MainThread, started 133887926009984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87582) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 20:22:42 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:UPDATE=21,cinder:INSERT=4,cinder:SELECT=10,cinder:DELETE=1 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 20:22:43 devstack cinder-volume[87582]: DEBUG dbcounter [-] [87582] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=87582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}